← Evaluations/EVAL-20260207-142929
code
Mar 17, 2026CODE-010

Create TypeScript types that enforce these compile-time constraints: 1. A `Route` type where the path parameters in the URL template must match the params object: - `createRoute('/users/:userId/posts/:postId', { userId: '123', postId: '456' })` ✓ - `createRoute('/users/:userId', { wrongParam: '123' })` ✗ (compile error) 2. A `Builder` pattern type where methods can only be called in a specific order: - `builder.setName('x').setAge(25).build()` ✓ - `builder.setAge(25).setName('x').build()` ✗ (compile error) - `builder.setName('x').build()` ✗ (compile error - age not set) Show the type definitions and example usage.

Winner
Claude Sonnet 4.5
Anthropic
9.49
WINNER SCORE
matrix avg: 7.87
results.json report.mdFull dataset (CSV) →
10×10 Judgment Matrix · 100 judgments
OPEN DATA
Judge ↓ / Respondent →Grok Code FastGLM-4-7Claude Opus 4.5Gemini 3Claude Sonnet 4.5Gemini 3MiniMax M2DeepSeek V3.2GPT-5.2-CodexGrok 3 (Direct)
Grok Code Fast0.09.89.89.65.50.09.69.89.6
GLM-4-79.89.39.89.85.80.00.09.89.8
Claude Opus 4.58.30.99.09.05.31.36.88.69.0
Gemini 39.80.09.610.06.50.09.89.89.8
Claude Sonnet 4.59.20.59.49.34.70.58.48.69.2
Gemini 30.00.00.00.00.00.00.00.00.0
MiniMax M210.00.08.49.89.84.710.09.49.8
DeepSeek V3.28.88.68.88.69.37.28.29.89.3
GPT-5.2-Codex8.80.07.88.88.84.10.08.68.8
Grok 3 (Direct)8.67.09.49.19.66.97.08.89.1