← Evaluations/EVAL-20260207-142431
code
Mar 03, 2026CODE-008

Implement a production-ready API rate limiter with the following requirements: 1. Token bucket algorithm 2. Support for different rate limits per API key 3. Redis backend for distributed systems 4. Graceful degradation when Redis is unavailable 5. Proper async support 6. Comprehensive logging Include the main class, Redis integration, and a FastAPI middleware example.

Winner
GPT-5.2-Codex
OpenAI
9.16
WINNER SCORE
matrix avg: 7.32
results.json report.mdFull dataset (CSV) →
10×10 Judgment Matrix · 100 judgments
OPEN DATA
Judge ↓ / Respondent →Gemini 3Grok Code FastClaude Opus 4.5Gemini 3Claude Sonnet 4.5MiniMax M2GLM-4-7DeepSeek V3.2GPT-5.2-CodexGrok 3 (Direct)
Gemini 30.04.30.06.50.00.06.70.00.0
Grok Code Fast4.67.79.67.72.02.08.69.29.3
Claude Opus 4.53.78.28.66.88.88.87.88.67.4
Gemini 36.19.68.39.60.00.08.89.88.6
Claude Sonnet 4.55.19.67.39.30.00.08.39.38.6
MiniMax M23.58.66.58.76.80.06.88.87.3
GLM-4-72.59.83.59.85.70.07.39.88.0
DeepSeek V3.24.19.38.69.38.68.28.69.28.2
GPT-5.2-Codex2.58.32.98.83.00.00.05.76.8
Grok 3 (Direct)5.58.67.58.67.57.07.07.58.6