Ran it, or it didn’t happen.

Benchmark open models on your own hardware. Runs count once their event log checks out.

Run your first benchmark

Cloud leaderboard

Every model runs on the same pinned machine. 17 models, 70 runs.

Machine
NVIDIA L40S · 48 GB
Engine
ollama 0.40.14
#ModelPass rate
1Qwen3.5-35B-A3BQ4_K_M96%
2Qwen3.5-27BQ4_K_M93%
3Qwen3-30B-A3B-Instruct-2507Q4_K_M92%
4GLM-4.7-FlashQ4_K_M89%
5Qwen3-Coder-30B-A3B-InstructQ4_K_M89%
6Qwen3-8BQ4_K_M89%
7Qwen3-14BQ4_K_M87%
8gemma-3-27b-itQ4_K_M86%
9gpt-oss-20bMXFP485%
10gemma-3-4b-itQ4_K_M83%
11Qwen3.5-2BQ4_K_M81%
12Qwen3-4BQ4_K_M78%
13gemma-3-12b-itQ4_K_M75%
14Llama-3.1-8B-InstructQ4_K_M71%
15Phi-3.5-mini-instructQ4_K_M64%
16MiniCPM5-2BQ4_K_M52%
17Mistral-7B-Instruct-v0.2Q4_K_M47%

Ranked by checks passed. A task a model can’t do is shown, not counted as a zero.

Open model leaderboard

139 open-weight models in chinese ranked by LMArena score · updated Nov 6, 2026

#ModelScore
1GLM-5.3zai-org1533
2GLM-5.3-Flashzai-org1529
3Kimi-K3moonshotai1527
4GLM-5.2zai-org1524
5Kimi-K2.6moonshotai1519
6GLM-5.1zai-org1515
7GLM-5zai-org1511
8MiMo-V2.5-ProXiaomiMiMo1506
9GLM-4.6zai-org1499
10Qwen3.5-397B-A17BQwen1498
11NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16nvidia1497
12Inklingthinkingmachines1495
13gemma-4-26B-A4Bgoogle1495
14Kimi-K2.5moonshotai1495
15GLM-4.7zai-org1495
16Qwen3.8-27BQwen1492
17Hy3tencent1486
18DeepSeek-V4-Prodeepseek-ai1481
19Qwen3-235B-A22B-Thinking-2507Qwen1481
20Qwen3.5-27BQwen1478
21gemma-4-31Bgoogle1475
22MiMo-V2.5XiaomiMiMo1470
23DeepSeek-V3.1deepseek-ai1468
24GLM-4.5zai-org1465
25Qwen3-235B-A22B-Instruct-2507Qwen1464
26MiniMax-M3MiniMaxAI1464
27DeepSeek-V4-Flashdeepseek-ai1464
28Inkling-Smallthinkingmachines1463
29MiMo-V2-FlashXiaomiMiMo1462
30Qwen3.5-122B-A10BQwen1462
31Qwen3-VL-235B-A22B-InstructQwen1462
32DeepSeek-V3.2-Expdeepseek-ai1462
33Qwen3-Next-80B-A3B-InstructQwen1460
34Qwen3.5-35B-A3BQwen1457
35DeepSeek-V3.2deepseek-ai1455
36NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16nvidia1452
37LongCat-Flash-Chatmeituan-longcat1449
38Step-3.5-Flashstepfun-ai1446
39Mistral-Large-3-675B-Instruct-2512mistralai1446
40Mistral-Medium-3.5-128Bmistralai1445
41DeepSeek-R1-0528deepseek-ai1442
42Qwen3-VL-235B-A22B-ThinkingQwen1441
43MiniMax-M2.7MiniMaxAI1440
44Hy3-previewtencent1434
45Qwen3-30B-A3B-Instruct-2507Qwen1433
46NVIDIA-Nemotron-3-Super-120B-A12B-BF16nvidia1432
47GLM-4.5-Airzai-org1426
48Qwen3-235B-A22BQwen1424
49GLM-4.6Vzai-org1424
50Beam-1.0-501B-A23Breflection1423
51granite-4.2-30bibm-granite1419
52Ling-flash-2.0inclusionAI1418
53Muse-Glimmer-30Bmeta-models1410
54Qwen3-Next-80B-A3B-ThinkingQwen1407
55GLM-4.7-Flashzai-org1404
56DeepSeek-R1deepseek-ai1400
57Ring-flash-2.0inclusionAI1399
58MiniMax-M2.5MiniMaxAI1394
59DeepSeek-V3-0324deepseek-ai1390
60gpt-oss-120bopenai1385
61NVIDIA-Nemotron-3-Nano-30B-A3B-BF16nvidia1383
62QwQ-32BQwen1378
63Trinity-Large-Thinkingarcee-ai1372
64MiniMax-M2MiniMaxAI1366
65NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16nvidia1365
66granite-4.2-8bibm-granite1363
67Qwen3-32BQwen1357
68Qwen3-Coder-480B-A35B-InstructQwen1357
69INTELLECT-3PrimeIntellect1354
70Trinity-Large-Previewarcee-ai1353
71Qwen3-30B-A3BQwen1347
72gemma-3-27b-itgoogle1346
73Mistral-Small-3.2-24B-Instruct-2506mistralai1340
74DeepSeek-V3deepseek-ai1338
75GLM-4.5Vzai-org1337
76granite-4.1-8bibm-granite1334
77DeepSeek-V2.5-1210deepseek-ai1318
78gpt-oss-20bopenai1315
79gemma-3n-E4B-itgoogle1309
80Olmo-3.1-32B-Instructallenai1304
81Olmo-3-32B-Thinkallenai1298
82DeepSeek-V2.5deepseek-ai1281
83Llama-4-Maverick-17B-128E-Instructmeta-llama1277
84granite-4.2-3bibm-granite1275
85Qwen2.5-72B-InstructQwen1272
86Llama-3.1-Nemotron-70B-Instructnvidia1263
87Llama-4-Scout-17B-16E-Instructmeta-llama1254
88Mistral-Small-3.1-24B-Instruct-2503mistralai1252
89granite-4.0-h-smallibm-granite1249
90Llama-3.1-Tulu-3-70Ballenai1249
91Llama-3.1-405B-Instructmeta-llama1242
92Olmo-3.1-32B-Thinkallenai1241
93Qwen2-72B-InstructQwen1240
94Qwen2.5-Coder-32B-InstructQwen1222
95gemma-2-27b-itgoogle1221
96QwQ-32B-PreviewQwen1218
97Llama-3.3-70B-Instructmeta-llama1217
98Llama-3.1-70B-Instructmeta-llama1215
99Nemotron-4-340B-Instructnvidia1214
100phi-4microsoft1212
101aya-expanse-32bCohereLabs1211
102Qwen1.5-110B-ChatQwen1206
103Mistral-Small-24B-Instruct-2501mistralai1204
104DeepSeek-Coder-V2-Instructdeepseek-ai1201
105Qwen1.5-72B-ChatQwen1186
106gemma-2-9b-itgoogle1185
107aya-expanse-8bCohereLabs1181
108Qwen1.5-32B-ChatQwen1177
109Llama-3.1-Tulu-3-8Ballenai1176
110Llama-3.1-8B-Instructmeta-llama1151
111Qwen1.5-14B-ChatQwen1147
112granite-3.1-8b-instructibm-granite1145
113Qwen1.5-7B-ChatQwen1141
114granite-3.1-2b-instructibm-granite1139
115gemma-2-2b-itgoogle1132
116deepseek-llm-67b-chatdeepseek-ai1132
117Mixtral-8x22B-Instruct-v0.1mistralai1116
118Meta-Llama-3-70B-Instructmeta-llama1114
119Phi-3-medium-4k-instructmicrosoft1108
120Qwen-14B-ChatQwen1077
121Meta-Llama-3-8B-Instructmeta-llama1076
122granite-3.0-2b-instructibm-granite1070
123granite-3.0-8b-instructibm-granite1063
124Phi-3-small-8k-instructmicrosoft1061
125gemma-1.1-7b-itgoogle1061
126Mixtral-8x7B-Instruct-v0.1mistralai1055
127gemma-7b-itgoogle1036
128Phi-3-mini-4k-instructmicrosoft1033
129Qwen1.5-4B-ChatQwen1024
130Llama-3.2-3B-Instructmeta-llama1017
131Phi-3-mini-128k-instructmicrosoft1016
132OLMo-7B-Instructallenai1014
133gemma-1.1-2b-itgoogle1012
134Mistral-7B-Instruct-v0.2mistralai1009
135Llama-2-13b-chat-hfmeta-llama1001
136Llama-2-70b-chat-hfmeta-llama995
137gemma-2b-itgoogle986
138Llama-2-7b-chat-hfmeta-llama973
139Llama-3.2-1B-Instructmeta-llama959
Show the top 20

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.