edge cases
Jan 16, 2026EDGE-001[This question would include a 10,000+ word document with a key detail ("The secret code is BLUE ELEPHANT") buried in paragraph 47 of 100] After reading the above document, what is the secret code mentioned? [Tests long-context retrieval accuracy]
Winner
DeepSeek V3.2
DeepSeek
9.35
WINNER SCORE
matrix avg: 8.18
10×10 Judgment Matrix · 100 judgments
OPEN DATA
| Judge ↓ / Respondent → | Claude Opus 4.5 | Gemini 3 | Claude Sonnet 4.5 | GPT-5.2-Codex | GPT-OSS-120B | Gemini 3 | DeepSeek V3.2 | MiMo-V2-Flash | Grok 4.1 Fast | Grok 3 (Direct) |
|---|---|---|---|---|---|---|---|---|---|---|
| Claude Opus 4.5 | — | 8.6 | 8.4 | 9.0 | 3.4 | 9.0 | 8.6 | 9.0 | 8.4 | 8.6 |
| Gemini 3 | 10.0 | — | 10.0 | 10.0 | 0.0 | 10.0 | 10.0 | 10.0 | 0.0 | 10.0 |
| Claude Sonnet 4.5 | 9.6 | 9.0 | — | 9.0 | 9.6 | 9.0 | 9.0 | 9.0 | 9.6 | 9.0 |
| GPT-5.2-Codex | 2.6 | 8.8 | 7.1 | — | 2.3 | 9.6 | 8.8 | 8.8 | 2.1 | 9.3 |
| GPT-OSS-120B | 4.2 | 8.8 | 8.4 | 8.6 | — | 8.4 | 9.0 | 9.4 | 8.8 | 9.0 |
| Gemini 3 | 10.0 | 10.0 | 10.0 | 10.0 | 2.0 | — | 10.0 | 9.0 | 10.0 | 10.0 |
| DeepSeek V3.2 | 8.7 | 8.0 | 9.6 | 8.0 | 3.3 | 8.2 | — | 8.0 | 10.0 | 8.2 |
| MiMo-V2-Flash | 10.0 | 10.0 | 10.0 | 10.0 | 2.0 | 10.0 | 10.0 | — | 10.0 | 8.4 |
| Grok 4.1 Fast | 9.6 | 9.6 | 9.0 | 10.0 | 2.1 | 10.0 | 10.0 | 10.0 | — | 10.0 |
| Grok 3 (Direct) | 1.9 | 8.7 | 1.9 | 8.7 | 1.9 | 9.4 | 8.7 | 8.7 | 1.9 | — |