← Evaluations/EVAL-20260402-225016
communication
Apr 02, 2026COMM-012

You're a CTO. Write three messages: (1) Email to the board: your product launch will be delayed 3 months due to a critical security vulnerability found in production. (2) Slack message to the engineering team explaining the delay without blaming anyone. (3) Public blog post for customers announcing the delay without revealing the security issue. Each must be honest while appropriate for the audience.

Winner
Claude Opus 4.6
openrouter
9.39
WINNER SCORE
matrix avg: 8.75
results.json report.mdFull dataset (CSV) →
10×10 Judgment Matrix · 84 judgments
OPEN DATA
Judge ↓ / Respondent →Claude Opus 4.6Grok 4.20GPT-5.4Claude Sonnet 4.6Gemini 3.1 ProDeepSeek V4GPT-OSS-120BMiMo-V2-FlashMistral SmallSeed 1.6 Flash
Claude Opus 4.69.09.69.88.48.49.60.59.28.2
Grok 4.208.89.08.88.39.08.88.38.88.8
GPT-5.49.38.89.35.5·7.5·6.57.3
Claude Sonnet 4.69.69.09.28.88.69.6·9.38.8
Gemini 3.1 Pro10.09.8·10.09.87.8·9.07.3
DeepSeek V49.89.89.89.89.69.88.39.89.8
GPT-OSS-120B8.88.48.88.87.38.6·8.88.8
MiMo-V2-Flash9.68.89.09.68.69.09.09.69.0
Mistral Small10.09.49.69.89.89.49.89.69.8
Seed 1.6 Flash8.78.08.68.68.68.38.48.28.6