coding Coding · llm-stats.com
SWE-Bench Pro
Harder, contamination-resistant successor to SWE-Bench with commercial-repo issues.
24
Modèles testés
Claude Mythos Preview
Modèle phare
77.8%
Meilleur score
Anthropic
Fournisseur
| # | Modèle | SWE-Bench Pro |
|---|---|---|
| 1 | Claude Mythos Preview Anthropic | 77.8% |
| 2 | Claude Opus 4.8 Anthropic | 69.2% |
| 3 | Qwen3.8 Max Alibaba | 67.7% |
| 4 | GPT-6 Astra OpenAI | 67% |
| 5 | Grok 4.5 xAI | 64.7% |
| 6 | GPT-5.6 Sol OpenAI | 64.6% |
| 7 | Claude Opus 4.7 Anthropic | 64.3% |
| 8 | GPT-5.6 Terra OpenAI | 63.4% |
| 9 | GPT-5.6 Luna OpenAI | 62.7% |
| 10 | GLM-5.2 Z.ai | 62.1% |
| 11 | Qwen3.7 Max Alibaba | 60.6% |
| 12 | GPT-5.5 OpenAI | 58.6% |
| 13 | Kimi K2.6 Moonshot AI | 58.6% |
| 14 | Qwen3.8 Flash Next Alibaba | 58% |
| 15 | Hunyuan Hy3 Tencent | 57.9% |
| 16 | GPT-5.4 OpenAI | 57.7% |
| 17 | Qwen3.7 Plus Alibaba | 57.6% |
| 18 | Qwen3.6 Plus Alibaba | 56.6% |
| 19 | DeepSeek V4 Pro DeepSeek | 55.4% |
| 20 | Gemini 3.1 Pro Google | 54.2% |
| 21 | GLM-5.3 Flash Z.ai | 54% |
| 22 | DeepSeek V4 Flash DeepSeek | 52.6% |
| 23 | Muse Spark Meta | 52.4% |
| 24 | 46.5% |
Données agrégées depuis llm-stats.com. Voir Méthodologie.