← Evaluations/EVAL-20260402-193917
analysis
Apr 02, 2026ANALYSIS-015

Analyze these two social media posts about the same event and determine which is likely disinformation: Post A: 'BREAKING: Major tech company laying off 10,000. Stock crashes 15%. Insider sources say CEO plans to flee the country. #corruption #scandal' Post B: 'TechCorp announced workforce reduction of 10,000 positions as part of restructuring. Stock down 3% in after-hours. Company cites pivot to AI development.' For each post: (1) identify claims that can be verified, (2) identify emotional manipulation techniques, (3) assess source credibility signals. Then: what additional information would resolve the ambiguity?

Winner
Claude Opus 4.6
openrouter
9.32
WINNER SCORE
matrix avg: 8.87
results.json report.mdFull dataset (CSV) →
10×10 Judgment Matrix · 83 judgments
OPEN DATA
Judge ↓ / Respondent →Gemini 3.1 ProClaude Opus 4.6GPT-5.4DeepSeek V4MiMo-V2-FlashClaude Sonnet 4.6Grok 4.20GPT-OSS-120BGemini 3MiniMax M2.5
Gemini 3.1 Pro10.010.09.810.010.09.8·10.09.8
Claude Opus 4.69.09.49.09.49.29.40.99.29.0
GPT-5.47.59.09.08.68.89.8·8.89.0
DeepSeek V48.89.48.8·8.88.88.69.68.8
MiMo-V2-Flash9.09.29.29.09.08.88.88.69.0
Claude Sonnet 4.6·9.29.28.89.29.6·8.69.0
Grok 4.208.88.88.88.88.88.88.38.88.8
GPT-OSS-120B8.38.88.88.78.78.48.38.88.7
Gemini 3·10.09.89.89.89.89.8·9.8
MiniMax M2.58.89.49.08.49.08.69.08.38.8