| # | Model | Arena score | Samples |
|---|---|---|---|
| 301 | command-r-plusCohere | 1,261±4 | 77,554 |
| 302 |  claude-3-haiku-20240307Anthropic | 1,261±4 | 117,701 |
| 303 | amazon-nova-lite-v1.0Amazon | 1,260±5 | 19,372 |
| 304 |  gemini-1.5-flash-8b-001Google | 1,259±4 | 35,558 |
| 305 | phi-4Microsoft | 1,256±5 | 24,126 |
| 306 | 1,251±11 | 3,334 | |
| 307 |
command-r-08-2024Cohere |
|---|
| 1,250±7 |
| 10,140 |
| 308 | mistral-large-2402Mistral | 1,242±5 | 62,436 |
|---|
| 309 | amazon-nova-micro-v1.0Amazon | 1,241±5 | 19,364 |
|---|
| 310 | jamba-1.5-miniNot listed | 1,240±7 | 8,858 |
|---|
| 311 | ministral-8b-2410Mistral | 1,237±9 | 4,781 |
|---|
| 312 | gemini-pro-dev-apiGoogle | 1,236±7 | 18,354 |
|---|
| 313 | qwen1.5-110b-chatAlibaba | 1,234±6 | 26,195 |
|---|
| 314 | reka-flash-21b-20240226-onlineNot listed | 1,233±7 | 15,450 |
|---|
| 315 | qwen1.5-72b-chatAlibaba | 1,233±5 | 39,302 |
|---|
| 316 | hunyuan-standard-256kTencent | 1,233±12 | 2,728 |
|---|
| 317 | mixtral-8x22b-instruct-v0.1Mistral | 1,229±5 | 51,416 |
|---|
| 318 | command-rCohere | 1,226±5 | 54,036 |
|---|
| 319 | reka-flash-21b-20240226Not listed | 1,226±6 | 24,806 |
|---|
| 320 |  gpt-3.5-turbo-0125OpenAI | 1,225±5 | 66,207 |
|---|
Dots: score · lines: published uncertainty