← Evaluations/EVAL-20260403-101702
analysis
Apr 03, 2026ANALYSIS-015

Analyze these two social media posts about the same event and determine which is likely disinformation: Post A: 'BREAKING: Major tech company laying off 10,000. Stock crashes 15%. Insider sources say CEO plans to flee the country. #corruption #scandal' Post B: 'TechCorp announced workforce reduction of 10,000 positions as part of restructuring. Stock down 3% in after-hours. Company cites pivot to AI development.' For each post: (1) identify claims that can be verified, (2) identify emotional manipulation techniques, (3) assess source credibility signals. Then: what additional information would resolve the ambiguity?

Winner
MiMo-V2-Flash
Xiaomi
9.29
WINNER SCORE
matrix avg: 9.09
↓ results.json↓ report.mdFull dataset (CSV) →
10×10 Judgment Matrix · 89 judgments
OPEN DATA
Judge ↓ / Respondent →DeepSeek V4Gemini 3.1 ProClaude Opus 4.6GPT-5.4MiMo-V2-FlashClaude Sonnet 4.6Grok 4.20GPT-OSS-120BGemini 3MiniMax M2.5
DeepSeek V4—8.89.68.89.08.89.49.28.88.8
Gemini 3.1 Pro9.8—10.010.010.09.89.89.89.89.8
Claude Opus 4.68.39.2—9.49.49.29.29.49.08.4
GPT-5.49.09.09.0—9.68.89.06.59.09.0
MiMo-V2-Flash9.08.89.09.2—8.68.88.88.89.0
Claude Sonnet 4.68.48.89.29.69.2—8.89.28.89.0
Grok 4.208.88.88.88.88.88.8—8.88.88.8
GPT-OSS-120B8.78.88.78.78.78.78.7—·8.4
Gemini 39.89.810.09.810.09.89.89.8—9.8
MiniMax M2.58.88.88.89.29.08.89.29.28.8—