Ran it, or it didn’t happen.

Benchmark open models on your own hardware. Runs count once their event log checks out.

Run your first benchmark

Cloud leaderboard

Every model runs on the same pinned machine. 17 models, 70 runs.

Machine
NVIDIA L40S · 48 GB
Engine
ollama 0.40.14
#ModelPass rate
1Qwen3.5-35B-A3BQ4_K_M96%
2Qwen3.5-27BQ4_K_M93%
3Qwen3-30B-A3B-Instruct-2507Q4_K_M92%
4GLM-4.7-FlashQ4_K_M89%
5Qwen3-Coder-30B-A3B-InstructQ4_K_M89%
6Qwen3-8BQ4_K_M89%
7Qwen3-14BQ4_K_M87%
8gemma-3-27b-itQ4_K_M86%
9gpt-oss-20bMXFP485%
10gemma-3-4b-itQ4_K_M83%
11Qwen3.5-2BQ4_K_M81%
12Qwen3-4BQ4_K_M78%
13gemma-3-12b-itQ4_K_M75%
14Llama-3.1-8B-InstructQ4_K_M71%
15Phi-3.5-mini-instructQ4_K_M64%
16MiniCPM5-2BQ4_K_M52%
17Mistral-7B-Instruct-v0.2Q4_K_M47%

Ranked by checks passed. A task a model can’t do is shown, not counted as a zero.

Open model leaderboard

139 open-weight models in chinese ranked by LMArena score · updated Nov 6, 2026

#ModelScore
139Llama-3.2-1B-Instructmeta-llama959
138Llama-2-7b-chat-hfmeta-llama973
137gemma-2b-itgoogle986
136Llama-2-70b-chat-hfmeta-llama995
135Llama-2-13b-chat-hfmeta-llama1001
134Mistral-7B-Instruct-v0.2mistralai1009
133gemma-1.1-2b-itgoogle1012
132OLMo-7B-Instructallenai1014
131Phi-3-mini-128k-instructmicrosoft1016
130Llama-3.2-3B-Instructmeta-llama1017
129Qwen1.5-4B-ChatQwen1024
128Phi-3-mini-4k-instructmicrosoft1033
127gemma-7b-itgoogle1036
126Mixtral-8x7B-Instruct-v0.1mistralai1055
125gemma-1.1-7b-itgoogle1061
124Phi-3-small-8k-instructmicrosoft1061
123granite-3.0-8b-instructibm-granite1063
122granite-3.0-2b-instructibm-granite1070
121Meta-Llama-3-8B-Instructmeta-llama1076
120Qwen-14B-ChatQwen1077
119Phi-3-medium-4k-instructmicrosoft1108
118Meta-Llama-3-70B-Instructmeta-llama1114
117Mixtral-8x22B-Instruct-v0.1mistralai1116
116deepseek-llm-67b-chatdeepseek-ai1132
115gemma-2-2b-itgoogle1132
114granite-3.1-2b-instructibm-granite1139
113Qwen1.5-7B-ChatQwen1141
112granite-3.1-8b-instructibm-granite1145
111Qwen1.5-14B-ChatQwen1147
110Llama-3.1-8B-Instructmeta-llama1151
109Llama-3.1-Tulu-3-8Ballenai1176
108Qwen1.5-32B-ChatQwen1177
107aya-expanse-8bCohereLabs1181
106gemma-2-9b-itgoogle1185
105Qwen1.5-72B-ChatQwen1186
104DeepSeek-Coder-V2-Instructdeepseek-ai1201
103Mistral-Small-24B-Instruct-2501mistralai1204
102Qwen1.5-110B-ChatQwen1206
101aya-expanse-32bCohereLabs1211
100phi-4microsoft1212
99Nemotron-4-340B-Instructnvidia1214
98Llama-3.1-70B-Instructmeta-llama1215
97Llama-3.3-70B-Instructmeta-llama1217
96QwQ-32B-PreviewQwen1218
95gemma-2-27b-itgoogle1221
94Qwen2.5-Coder-32B-InstructQwen1222
93Qwen2-72B-InstructQwen1240
92Olmo-3.1-32B-Thinkallenai1241
91Llama-3.1-405B-Instructmeta-llama1242
90Llama-3.1-Tulu-3-70Ballenai1249
89granite-4.0-h-smallibm-granite1249
88Mistral-Small-3.1-24B-Instruct-2503mistralai1252
87Llama-4-Scout-17B-16E-Instructmeta-llama1254
86Llama-3.1-Nemotron-70B-Instructnvidia1263
85Qwen2.5-72B-InstructQwen1272
84granite-4.2-3bibm-granite1275
83Llama-4-Maverick-17B-128E-Instructmeta-llama1277
82DeepSeek-V2.5deepseek-ai1281
81Olmo-3-32B-Thinkallenai1298
80Olmo-3.1-32B-Instructallenai1304
79gemma-3n-E4B-itgoogle1309
78gpt-oss-20bopenai1315
77DeepSeek-V2.5-1210deepseek-ai1318
76granite-4.1-8bibm-granite1334
75GLM-4.5Vzai-org1337
74DeepSeek-V3deepseek-ai1338
73Mistral-Small-3.2-24B-Instruct-2506mistralai1340
72gemma-3-27b-itgoogle1346
71Qwen3-30B-A3BQwen1347
70Trinity-Large-Previewarcee-ai1353
69INTELLECT-3PrimeIntellect1354
68Qwen3-Coder-480B-A35B-InstructQwen1357
67Qwen3-32BQwen1357
66granite-4.2-8bibm-granite1363
65NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16nvidia1365
64MiniMax-M2MiniMaxAI1366
63Trinity-Large-Thinkingarcee-ai1372
62QwQ-32BQwen1378
61NVIDIA-Nemotron-3-Nano-30B-A3B-BF16nvidia1383
60gpt-oss-120bopenai1385
59DeepSeek-V3-0324deepseek-ai1390
58MiniMax-M2.5MiniMaxAI1394
57Ring-flash-2.0inclusionAI1399
56DeepSeek-R1deepseek-ai1400
55GLM-4.7-Flashzai-org1404
54Qwen3-Next-80B-A3B-ThinkingQwen1407
53Muse-Glimmer-30Bmeta-models1410
52Ling-flash-2.0inclusionAI1418
51granite-4.2-30bibm-granite1419
50Beam-1.0-501B-A23Breflection1423
49GLM-4.6Vzai-org1424
48Qwen3-235B-A22BQwen1424
47GLM-4.5-Airzai-org1426
46NVIDIA-Nemotron-3-Super-120B-A12B-BF16nvidia1432
45Qwen3-30B-A3B-Instruct-2507Qwen1433
44Hy3-previewtencent1434
43MiniMax-M2.7MiniMaxAI1440
42Qwen3-VL-235B-A22B-ThinkingQwen1441
41DeepSeek-R1-0528deepseek-ai1442
40Mistral-Medium-3.5-128Bmistralai1445
39Mistral-Large-3-675B-Instruct-2512mistralai1446
38Step-3.5-Flashstepfun-ai1446
37LongCat-Flash-Chatmeituan-longcat1449
36NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16nvidia1452
35DeepSeek-V3.2deepseek-ai1455
34Qwen3.5-35B-A3BQwen1457
33Qwen3-Next-80B-A3B-InstructQwen1460
32DeepSeek-V3.2-Expdeepseek-ai1462
31Qwen3-VL-235B-A22B-InstructQwen1462
30Qwen3.5-122B-A10BQwen1462
29MiMo-V2-FlashXiaomiMiMo1462
28Inkling-Smallthinkingmachines1463
27DeepSeek-V4-Flashdeepseek-ai1464
26MiniMax-M3MiniMaxAI1464
25Qwen3-235B-A22B-Instruct-2507Qwen1464
24GLM-4.5zai-org1465
23DeepSeek-V3.1deepseek-ai1468
22MiMo-V2.5XiaomiMiMo1470
21gemma-4-31Bgoogle1475
20Qwen3.5-27BQwen1478
19Qwen3-235B-A22B-Thinking-2507Qwen1481
18DeepSeek-V4-Prodeepseek-ai1481
17Hy3tencent1486
16Qwen3.8-27BQwen1492
15GLM-4.7zai-org1495
14Kimi-K2.5moonshotai1495
13gemma-4-26B-A4Bgoogle1495
12Inklingthinkingmachines1495
11NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16nvidia1497
10Qwen3.5-397B-A17BQwen1498
9GLM-4.6zai-org1499
8MiMo-V2.5-ProXiaomiMiMo1506
7GLM-5zai-org1511
6GLM-5.1zai-org1515
5Kimi-K2.6moonshotai1519
4GLM-5.2zai-org1524
3Kimi-K3moonshotai1527
2GLM-5.3-Flashzai-org1529
1GLM-5.3zai-org1533
Show the top 20

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.