← Evaluations/EVAL-20260207-133004
reasoning
Jan 21, 2026REASON-002

Five people (Alice, Bob, Carol, Dave, Eve) need to schedule meetings. Use these clues to determine who meets with whom on which day: 1. Each person has exactly one meeting per day (Mon-Fri) 2. Each meeting involves exactly two people 3. No person meets with the same person twice during the week 4. Alice meets with Bob before she meets with Carol 5. Dave's meeting with Eve is exactly two days after Bob's meeting with Carol 6. Carol doesn't have any meetings on Monday or Friday 7. Eve meets with Alice on Wednesday 8. Bob's meeting with Dave is the day after Alice's meeting with Dave 9. The Monday meeting involves neither Dave nor Eve Create a complete schedule showing all meetings for the week.

Winner
OLMo Think
Allen AI
9.15
WINNER SCORE
matrix avg: 5.22
results.json report.mdFull dataset (CSV) →
10×10 Judgment Matrix · 100 judgments
OPEN DATA
Judge ↓ / Respondent →Grok 3 (Direct)MiMo-V2-FlashGemini 3Claude Sonnet 4.5DeepSeek V3.2Claude Opus 4.5Gemini 3Gemini 2.5 FlashGPT-OSS-120BOLMo Think
Grok 3 (Direct)3.69.03.61.98.60.04.38.30.0
MiMo-V2-Flash3.21.62.61.92.60.21.23.010.0
Gemini 33.64.63.23.09.80.03.010.00.0
Claude Sonnet 4.56.74.44.22.39.20.03.69.30.0
DeepSeek V3.23.86.110.02.59.310.03.510.010.0
Claude Opus 4.53.64.09.22.83.00.93.03.60.0
Gemini 30.00.00.00.00.00.00.010.00.0
Gemini 2.5 Flash4.00.00.00.60.60.07.510.07.5
GPT-OSS-120B3.64.30.00.03.23.40.00.00.0
OLMo Think0.00.00.01.90.00.00.00.00.0