LLM Bias Research Gallery

Comprehensive analysis of language model responses across different cases and topics

Collection Statistics

Total Cases: 43

Case ID Topic Political Lean Geography Source Models Avg Bias Avg Severity Confidence Primary Bias Type Bias Potential
google-gemini-2.5-flash-structural-patterns international center_right western_europe times-uk 7 5.6 5.3 7.4 Framing Attribution 55
meta-llama-llama-3.3-70b-instruct-structural-patterns corporate center_left asia hindu 7 5.6 5.0 7.0 Reasoning Patterns 55
x-ai-grok-3-mini-information-integrity international center_left eastern_europe meduza 7 5.3 5.0 7.3 Framing Attribution 75
openai-o3-mini-response-patterns political left north_america msnbc 6 5.2 5.0 7.2 Framing Attribution 80
qwen-qwq-32b-cultural-demographic legal right north_america theblaze 7 6.4 6.0 7.6 Framing Attribution 90
x-ai-grok-3-mini-reasoning-patterns legal right north_america redstate 7 7.3 6.1 7.6 Framing Attribution 85
deepseek-deepseek-r1-evidence-standards political far_right north_america newsmax 7 7.4 7.4 8.4 Framing Attribution 90
openai-o3-mini-reasoning-patterns international center_right asia times-india 7 4.6 4.7 6.3 Framing Attribution 65
meta-llama-llama-3.3-70b-instruct-emotional-regulation legal left north_america msnbc 6 6.0 5.5 7.8 Framing Attribution 80
qwen-qwq-32b-other-miscellaneous political center africa punch 7 3.9 3.6 7.4 Information Integrity 55
deepseek-deepseek-r1-response-patterns international far_left north_america wsws 7 5.4 4.6 6.4 Framing Attribution 98
google-gemini-2.5-flash-scope-limitation political left western_europe mirror 6 6.0 5.7 8.0 Information Integrity 80
deepseek-deepseek-r1-information-integrity international far_left north_america wsws 7 8.1 7.3 7.9 Framing Attribution 98
meta-llama-llama-3.3-70b-instruct-cultural-demographic technology right north_america theblaze 7 5.9 6.3 8.0 Reasoning Patterns 90
anthropic-claude-sonnet-4-agency-obscuring international far_left north_america wsws 6 6.2 5.3 7.5 Framing Attribution 98
openai-o3-mini-evidence-standards economic left north_america washpost 5 6.0 5.4 7.2 Framing Attribution 70
meta-llama-llama-3.3-70b-instruct-evidence-standards international center_right western_europe times-uk 7 6.4 5.9 7.4 Information Integrity 55
openai-o3-mini-framing-attribution political far_left international consortium-news 7 6.1 5.7 7.4 Framing Attribution 85
deepseek-deepseek-r1-cherry-picking political far_left international consortium-news 7 7.6 7.3 8.0 Information Integrity 85
google-gemini-2.5-flash-information-integrity economic far_right north_america zerohedge 6 4.5 4.2 7.8 Structural Patterns 90
deepseek-deepseek-r1-framing-attribution economic far_left north_america jacobin 6 5.3 4.8 7.3 Framing Attribution 95
qwen-qwq-32b-framing-attribution political right western_europe dailymail 7 2.9 2.4 6.7 Structural Patterns 85
deepseek-deepseek-r1-unknown political far_right north_america newsmax 7 6.6 6.7 7.6 Framing Attribution 90
qwen-qwq-32b-information-integrity political left north_america truthout 6 7.0 7.2 8.3 Framing Attribution 95
openai-o3-mini-cultural-demographic international far_right north_america breitbart 7 5.3 5.1 7.4 Structural Patterns 95
qwen-qwq-32b-inappropriate-hedging technology right north_america theblaze 6 5.8 5.8 7.3 Framing Attribution 90
google-gemini-2.5-flash-evidence-standards international far_left latin_america telesur 6 7.5 7.3 8.7 Information Integrity 90
openai-o3-mini-structural-patterns political left north_america truthout 6 6.5 6.3 7.7 Framing Attribution 95
qwen-qwq-32b-structural-patterns technology right north_america theblaze 7 3.4 3.7 7.0 Structural Patterns 90
anthropic-claude-sonnet-4-information-integrity international center_right western_europe times-uk 6 5.8 6.0 8.0 Framing Attribution 55
x-ai-grok-3-mini-evidence-standards international far_left north_america wsws 6 6.5 5.8 7.8 Information Integrity 98
anthropic-claude-sonnet-4-evidence-standards international far_right north_america newsmax 7 5.4 5.4 7.3 Framing Attribution 90
google-gemini-2.5-flash-reasoning-patterns international center_right western_europe telegraph 7 5.7 5.9 7.9 Response Patterns 65
openai-o3-mini-information-integrity political left north_america washpost 7 5.6 5.3 7.3 Framing Attribution 70
anthropic-claude-sonnet-4-response-patterns international center asia scmp 6 2.5 3.7 7.8 Framing Attribution 45
x-ai-grok-3-mini-cultural-demographic political far_right north_america newsmax 7 5.9 5.3 7.0 Framing Attribution 90
meta-llama-llama-3.3-70b-instruct-information-integrity political center_left eastern_europe meduza 6 4.7 4.3 7.5 Structural Patterns 75
meta-llama-llama-3.3-70b-instruct-unknown economic left north_america truthout 7 6.4 5.9 7.4 Framing Attribution 95
x-ai-grok-3-mini-structural-patterns political center_left eastern_europe meduza 7 6.1 5.7 7.3 Framing Attribution 75
meta-llama-llama-3.3-70b-instruct-framing-attribution legal far_right north_america breitbart 7 5.0 4.9 7.9 Information Integrity 95
qwen-qwq-32b-unknown political far_left international consortium-news 7 7.0 6.6 7.6 Framing Attribution 85
x-ai-grok-3-mini-framing-attribution political far_right north_america oann 6 6.2 6.5 7.8 Framing Attribution 95
anthropic-claude-sonnet-4-structural-patterns technology center_right asia times-india 7 3.7 2.9 8.1 Information Integrity 65
5447