Loading page…
Benchmarks
| # | Model | Arena score | Samples |
|---|---|---|---|
| 281 | 1,287±11 | 3,098 | |
| 282 |  gemini-1.5-flash-001Google | 1,286±5 | 62,833 |
| 283 | 1,286±10 | 3,749 | |
| 284 | 1,286±10 | 2,846 | |
| 285 | 1,286±8 | 5,531 | |
| 286 | 1,286±7 | 8,114 | |
| 287 |
| # | Model | Arena score | Samples |
|---|---|---|---|
| 281 | 1,287±11 | 3,098 | |
| 282 | gemini-1.5-flash-001Google | 1,286±5 | 62,833 |
| 283 | 1,286±10 | 3,749 | |
| 284 | 1,286±10 | 2,846 | |
| 285 | 1,286±8 | 5,531 | |
| 286 | 1,286±7 | 8,114 | |
| 287 |
 claude-3-sonnet-20240229Anthropic |
|---|
| 1,281±4 |
| 109,284 |
| 288 | gemma-2-9b-it-simpoNot listed | 1,280±7 | 10,072 |
|---|
| 289 | nemotron-4-340b-instructNvidia | 1,277±5 | 19,659 |
|---|
| 290 | 1,276±4 | 156,876 |
| 291 | command-r-plus-08-2024Cohere | 1,276±7 | 9,866 |
|---|
| 292 |  gpt-4-0613OpenAI | 1,276±4 | 88,723 |
|---|
| 293 | 1,274±6 | 14,681 |
| 294 |  glm-4-0520Z.ai | 1,273±7 | 9,788 |
|---|
| 295 | reka-flash-20240904Not listed | 1,272±7 | 7,536 |
|---|
| 296 | qwen2.5-coder-32b-instructAlibaba | 1,270±8 | 5,432 |
|---|
| 297 | c4ai-aya-expanse-32bCohere | 1,267±5 | 27,124 |
|---|
| 298 | gemma-2-9b-itGoogle | 1,267±4 | 54,611 |
|---|
| 299 |  deepseek-coder-v2DeepSeek | 1,265±6 | 15,147 |
|---|
| 300 | qwen2-72b-instructAlibaba | 1,261±5 | 37,325 |
|---|
Dots: score · lines: published uncertainty