← Evaluations/EVAL-20260402-154152
reasoning
Feb 04, 2026REASON-004

On an island, there are 100 people with blue eyes and 100 people with brown eyes. Everyone can see everyone else's eye color but not their own. There are no mirrors or ways to discover your own eye color. There's a rule: if you ever figure out your own eye color, you must leave the island at midnight that day. One day, a visitor announces to everyone: "At least one person on this island has blue eyes." What happens? When? Why? Be precise about the logical chain of events.

Winner
Grok 4.20
openrouter
9.66
WINNER SCORE
matrix avg: 9.05
results.json report.mdFull dataset (CSV) →
10×10 Judgment Matrix · 81 judgments
OPEN DATA
Judge ↓ / Respondent →GPT-OSS-120BGemini 3.1 ProDeepSeek V4Claude Opus 4.6GPT-5.4Grok 4.20Claude Sonnet 4.6MiMo-V2-FlashGemini 2.5 FlashMiniMax M2.5
GPT-OSS-120B5.89.18.78.99.18.48.74.8·
Gemini 3.1 Pro9.410.010.010.010.010.010.06.0·
DeepSeek V49.78.49.79.79.59.79.59.7·
Claude Opus 4.69.67.39.49.49.79.710.07.5·
GPT-5.410.05.59.89.89.89.48.85.8·
Grok 4.208.87.98.78.88.88.78.87.5·
Claude Sonnet 4.69.68.18.810.09.89.79.48.0·
MiMo-V2-Flash10.08.810.010.010.010.010.08.6·
Gemini 2.5 Flash9.89.79.89.89.89.89.89.8·
MiniMax M2.59.46.79.39.69.49.49.610.06.0