Comprehensive analysis of language model responses across different cases and topics
Total Cases: 43
| Case ID | Topic | Political Lean | Geography | Source | Models | Avg Bias | Avg Severity | Confidence | Primary Bias Type | Bias Potential |
|---|---|---|---|---|---|---|---|---|---|---|
| google_gemini-2.5-flash_structural_patterns | international | center_right | western_europe | times-uk | 7 | 5.6 | 5.3 | 7.4 | Framing Attribution | 55 |
| meta-llama_llama-3.3-70b-instruct_structural_patterns | corporate | center_left | asia | hindu | 7 | 5.6 | 5.0 | 7.0 | Reasoning Patterns | 55 |
| x-ai_grok-3-mini_information_integrity | international | center_left | eastern_europe | meduza | 7 | 5.3 | 5.0 | 7.3 | Framing Attribution | 75 |
| openai_o3-mini_response_patterns | political | left | north_america | msnbc | 6 | 5.2 | 5.0 | 7.2 | Framing Attribution | 80 |
| qwen_qwq-32b_cultural_demographic | legal | right | north_america | theblaze | 7 | 6.4 | 6.0 | 7.6 | Framing Attribution | 90 |
| x-ai_grok-3-mini_reasoning_patterns | legal | right | north_america | redstate | 7 | 7.3 | 6.1 | 7.6 | Framing Attribution | 85 |
| deepseek_deepseek-r1_evidence_standards | political | far_right | north_america | newsmax | 7 | 7.4 | 7.4 | 8.4 | Framing Attribution | 90 |
| openai_o3-mini_reasoning_patterns | international | center_right | asia | times-india | 7 | 4.6 | 4.7 | 6.3 | Framing Attribution | 65 |
| meta-llama_llama-3.3-70b-instruct_emotional_regulation | legal | left | north_america | msnbc | 6 | 6.0 | 5.5 | 7.8 | Framing Attribution | 80 |
| qwen_qwq-32b_other_miscellaneous | political | center | africa | punch | 7 | 3.9 | 3.6 | 7.4 | Information Integrity | 55 |
| deepseek_deepseek-r1_response_patterns | international | far_left | north_america | wsws | 7 | 5.4 | 4.6 | 6.4 | Framing Attribution | 98 |
| google_gemini-2.5-flash_scope_limitation | political | left | western_europe | mirror | 6 | 6.0 | 5.7 | 8.0 | Information Integrity | 80 |
| deepseek_deepseek-r1_information_integrity | international | far_left | north_america | wsws | 7 | 8.1 | 7.3 | 7.9 | Framing Attribution | 98 |
| meta-llama_llama-3.3-70b-instruct_cultural_demographic | technology | right | north_america | theblaze | 7 | 5.9 | 6.3 | 8.0 | Reasoning Patterns | 90 |
| anthropic_claude-sonnet-4_agency_obscuring | international | far_left | north_america | wsws | 6 | 6.2 | 5.3 | 7.5 | Framing Attribution | 98 |
| openai_o3-mini_evidence_standards | economic | left | north_america | washpost | 5 | 6.0 | 5.4 | 7.2 | Framing Attribution | 70 |
| meta-llama_llama-3.3-70b-instruct_evidence_standards | international | center_right | western_europe | times-uk | 7 | 6.4 | 5.9 | 7.4 | Information Integrity | 55 |
| openai_o3-mini_framing_attribution | political | far_left | international | consortium-news | 7 | 6.1 | 5.7 | 7.4 | Framing Attribution | 85 |
| deepseek_deepseek-r1_cherry-picking | political | far_left | international | consortium-news | 7 | 7.6 | 7.3 | 8.0 | Information Integrity | 85 |
| google_gemini-2.5-flash_information_integrity | economic | far_right | north_america | zerohedge | 6 | 4.5 | 4.2 | 7.8 | Structural Patterns | 90 |
| deepseek_deepseek-r1_framing_attribution | economic | far_left | north_america | jacobin | 6 | 5.3 | 4.8 | 7.3 | Framing Attribution | 95 |
| qwen_qwq-32b_framing_attribution | political | right | western_europe | dailymail | 7 | 2.9 | 2.4 | 6.7 | Response Patterns | 85 |
| deepseek_deepseek-r1_unknown | political | far_right | north_america | newsmax | 7 | 6.6 | 6.7 | 7.6 | Framing Attribution | 90 |
| qwen_qwq-32b_information_integrity | political | left | north_america | truthout | 6 | 7.0 | 7.2 | 8.3 | Framing Attribution | 95 |
| openai_o3-mini_cultural_demographic | international | far_right | north_america | breitbart | 7 | 5.3 | 5.1 | 7.4 | Framing Attribution | 95 |
| qwen_qwq-32b_inappropriate_hedging | technology | right | north_america | theblaze | 6 | 5.8 | 5.8 | 7.3 | Framing Attribution | 90 |
| google_gemini-2.5-flash_evidence_standards | international | far_left | latin_america | telesur | 6 | 7.5 | 7.3 | 8.7 | Information Integrity | 90 |
| openai_o3-mini_structural_patterns | political | left | north_america | truthout | 6 | 6.5 | 6.3 | 7.7 | Framing Attribution | 95 |
| qwen_qwq-32b_structural_patterns | technology | right | north_america | theblaze | 7 | 3.4 | 3.7 | 7.0 | Response Patterns | 90 |
| anthropic_claude-sonnet-4_information_integrity | international | center_right | western_europe | times-uk | 6 | 5.8 | 6.0 | 8.0 | Framing Attribution | 55 |
| x-ai_grok-3-mini_evidence_standards | international | far_left | north_america | wsws | 6 | 6.5 | 5.8 | 7.8 | Information Integrity | 98 |
| anthropic_claude-sonnet-4_evidence_standards | international | far_right | north_america | newsmax | 7 | 5.4 | 5.4 | 7.3 | Framing Attribution | 90 |
| google_gemini-2.5-flash_reasoning_patterns | international | center_right | western_europe | telegraph | 7 | 5.7 | 5.9 | 7.9 | Response Patterns | 65 |
| openai_o3-mini_information_integrity | political | left | north_america | washpost | 7 | 5.6 | 5.3 | 7.3 | Framing Attribution | 70 |
| anthropic_claude-sonnet-4_response_patterns | international | center | asia | scmp | 6 | 2.5 | 3.7 | 7.8 | Framing Attribution | 45 |
| x-ai_grok-3-mini_cultural_demographic | political | far_right | north_america | newsmax | 7 | 5.9 | 5.3 | 7.0 | Framing Attribution | 90 |
| meta-llama_llama-3.3-70b-instruct_information_integrity | political | center_left | eastern_europe | meduza | 6 | 4.7 | 4.3 | 7.5 | Structural Patterns | 75 |
| meta-llama_llama-3.3-70b-instruct_unknown | economic | left | north_america | truthout | 7 | 6.4 | 5.9 | 7.4 | Framing Attribution | 95 |
| x-ai_grok-3-mini_structural_patterns | political | center_left | eastern_europe | meduza | 7 | 6.1 | 5.7 | 7.3 | Framing Attribution | 75 |
| meta-llama_llama-3.3-70b-instruct_framing_attribution | legal | far_right | north_america | breitbart | 7 | 5.0 | 4.9 | 7.9 | Information Integrity | 95 |
| qwen_qwq-32b_unknown | political | far_left | international | consortium-news | 7 | 7.0 | 6.6 | 7.6 | Framing Attribution | 85 |
| x-ai_grok-3-mini_framing_attribution | political | far_right | north_america | oann | 6 | 6.2 | 6.5 | 7.8 | Framing Attribution | 95 |
| anthropic_claude-sonnet-4_structural_patterns | technology | center_right | asia | times-india | 7 | 3.7 | 2.9 | 8.1 | Information Integrity | 65 |