Ran it, or it didn’t happen.

Benchmark open models on your own hardware. Runs count once their event log checks out.

Recent verified runsWhereSpeed

PassedFailedNot supported

Cloud leaderboard

Every model runs on the same pinned machine. 17 models, 70 runs.

Suite: [email protected]
Machine: NVIDIA L40S · 48 GB
Engine: ollama 0.40.14

#	Model	Pass rate				Speed	Runs
1	Qwen3.5-35B-A3BQ4_K_M	96%	9/9	8/9	9/9	201.4 tok/s	3
2	Qwen3.5-27BQ4_K_M	93%	8/9	9/9	8/9	35.5 tok/s	3
3	Qwen3-30B-A3B-Instruct-2507Q4_K_M	92%	11/12	10/12	12/12	187.6 tok/s	4
4	GLM-4.7-FlashQ4_K_M	89%	9/9	6/9	9/9	201.7 tok/s	3
5	Qwen3-Coder-30B-A3B-InstructQ4_K_M	89%	9/9	7/9	8/9	186.4 tok/s	3
6	Qwen3-8BQ4_K_M	89%	9/12	11/12	12/12	120.7 tok/s	4
7	Qwen3-14BQ4_K_M	87%	13/15	11/15	15/15	67.1 tok/s	5
8	gemma-3-27b-itQ4_K_M	86%	17/18	Not supported	14/18	36.2 tok/s	6
9	gpt-oss-20bMXFP4	85%	9/9	9/9	5/9	173.8 tok/s	3
10	gemma-3-4b-itQ4_K_M	83%	11/15	Not supported	14/15	232.7 tok/s	5
11	Qwen3.5-2BQ4_K_M	81%	9/12	9/12	11/12	298.1 tok/s	4
12	Qwen3-4BQ4_K_M	78%	6/9	6/9	9/9	247.9 tok/s	3
13	gemma-3-12b-itQ4_K_M	75%	8/12	Not supported	10/12	80.9 tok/s	4
14	Llama-3.1-8B-InstructQ4_K_M	71%	8/15	9/15	15/15	124.4 tok/s	5
15	Phi-3.5-mini-instructQ4_K_M	64%	9/18	Not supported	14/18	261.3 tok/s	6
16	MiniCPM5-2BQ4_K_M	52%	4/9	3/9	7/9	301.4 tok/s	3
17	Mistral-7B-Instruct-v0.2Q4_K_M	47%	6/18	Not supported	11/18	137.1 tok/s	6

Ranked by checks passed. A task a model can’t do is shown, not counted as a zero.

Open model leaderboard

144 open-weight models in non-english ranked by LMArena score · updated Nov 6, 2026

Top rated

Most downloaded

Newest

All sizes ≤3B 3–9B 9–20B 20–40B 40–80B >80B

#	Model	Score	Votes	Params	License	Downloads	Likes
144	gemma-2b-itgoogle	958	1.8K	2.5B	Gemma	14K	975
143	Llama-2-7b-chat-hfmeta-llama	973	3.9K	6.7B	Llama 2	126.4K	4,951
142	Llama-3.2-1B-Instructmeta-llama	973	3.7K	1.2B	Llama 3.2	1.5M	1,961
141	OLMo-7B-Instructallenai	977	2.3K	6.9B	Apache 2.0	846	54
140	Qwen1.5-4B-ChatQwen	979	2.8K	4.0B	Custom	15.9K	53
139	gemma-1.1-2b-itgoogle	988	4.9K	2.5B	Gemma	6.1K	175
138	gemma-7b-itgoogle	998	3.2K	8.5B	Gemma	25.3K	1,263
137	Phi-3-mini-128k-instructmicrosoft	1000	8.1K	3.8B	MIT	238.7K	1,713
136	Mistral-7B-Instruct-v0.2mistralai	1012	6.7K	7.2B	Apache 2.0	1.6M	3,280
135	SOLAR-10.7B-Instruct-v1.0upstage	1014	878	10.7B	CC BY-NC 4.0	48.7K	660
134	Llama-3.2-3B-Instructmeta-llama	1019	3.8K	3.2B	Llama 3.2	914.1K	2,963
133	Phi-3-mini-4k-instructmicrosoft	1020	9.8K	3.8B	MIT	329.2K	1,489
132	Llama-2-13b-chat-hfmeta-llama	1024	5.3K	13.0B	Llama 2	148.8K	1,138
131	granite-3.0-2b-instructibm-granite	1032	3.5K	2.6B	Apache 2.0	3.2K	48
130	granite-3.0-8b-instructibm-granite	1037	3.3K	8.2B	Apache 2.0	13.3K	209
129	Qwen-14B-ChatQwen	1041	1.1K	14.2B	—	5.2K	381
128	Llama-2-70b-chat-hfmeta-llama	1045	12.4K	69.0B	Llama 2	4.8K	2,211
127	gemma-1.1-7b-itgoogle	1051	11.2K	8.5B	Gemma	4.2K	276
126	Phi-3-small-8k-instructmicrosoft	1058	8.7K	7.4B	MIT	7.1K	182
125	Qwen1.5-7B-ChatQwen	1058	1.5K	7.7B	Tongyi Qianwen	7K	192
124	granite-3.1-2b-instructibm-granite	1068	1.4K	2.5B	Apache 2.0	24.5K	57
123	deepseek-llm-67b-chatdeepseek-ai	1073	1.1K	—	Custom	2.8K	222
122	Mixtral-8x7B-Instruct-v0.1mistralai	1077	27.2K	46.7B	Apache 2.0	298.7K	4,777
121	Phi-3-medium-4k-instructmicrosoft	1094	11.8K	14.0B	MIT	18.7K	231
120	Qwen1.5-14B-ChatQwen	1094	8.3K	14.2B	Tongyi Qianwen	12.2K	118
119	Meta-Llama-3-8B-Instructmeta-llama	1097	42.9K	8.0B	Llama 3	359.6K	5,787
118	granite-3.1-8b-instructibm-granite	1099	1.4K	8.2B	Apache 2.0	27.4K	169
117	Qwen1.5-32B-ChatQwen	1106	9.9K	32.5B	Tongyi Qianwen	46.8K	115
116	gemma-2-2b-itgoogle	1121	20.9K	2.6B	Gemma	125.7K	1,607
115	Mixtral-8x22B-Instruct-v0.1mistralai	1128	21.5K	141B	Apache 2.0	38.7K	780
114	QwQ-32B-PreviewQwen	1129	1.4K	32.8B	Apache 2.0	7.1K	1,747
113	Qwen1.5-72B-ChatQwen	1135	14.3K	72.3B	Tongyi Qianwen	11.2K	224
112	Meta-Llama-3-70B-Instructmeta-llama	1142	66.3K	70.6B	Llama 3	37.8K	1,537
111	Qwen1.5-110B-ChatQwen	1142	12.3K	111B	Tongyi Qianwen	2.7K	139
110	Llama-3.1-8B-Instructmeta-llama	1148	23K	8.0B	Llama 3.1	4.3M	8,836
109	Llama-3.1-Tulu-3-8Ballenai	1169	1.3K	8.0B	Llama 3.1	5K	178
108	Qwen2-72B-InstructQwen	1176	17.4K	72.7B	Tongyi Qianwen	24.3K	724
107	aya-expanse-8bCohereLabs	1180	4.3K	8.0B	CC BY-NC 4.0	22.9K	463
106	DeepSeek-Coder-V2-Instructdeepseek-ai	1182	7K	236B	Custom	3.8K	718
105	gemma-2-9b-itgoogle	1188	24.8K	9.2B	Gemma	113.6K	1,166
104	phi-4microsoft	1197	10K	14.7B	MIT	293.7K	2,340
103	Mistral-Small-24B-Instruct-2501mistralai	1198	5.9K	23.6B	Apache 2.0	94.4K	991
102	Qwen2.5-Coder-32B-InstructQwen	1204	2.8K	32.8B	Apache 2.0	548.8K	2,206
101	Nemotron-4-340B-Instructnvidia	1206	9.4K	—	Custom	638	703
100	Olmo-3.1-32B-Thinkallenai	1209	5K	32.2B	Apache 2.0	7K	120
99	aya-expanse-32bCohereLabs	1213	12.8K	32.3B	CC BY-NC 4.0	3K	303
98	granite-4.0-h-smallibm-granite	1216	3.1K	32.2B	Apache 2.0	23.5K	313
97	gemma-2-27b-itgoogle	1217	34.5K	27.2B	Gemma	21.7K	577
96	Llama-3.1-70B-Instructmeta-llama	1219	25.5K	70.6B	Llama 3.1	92K	1,027
95	Llama-3.1-Tulu-3-70Ballenai	1235	1.2K	70.6B	Llama 3.1	965	61
94	Llama-3.3-70B-Instructmeta-llama	1236	25.2K	70.6B	Llama 3.3	357.4K	3,197
93	Llama-3.1-Nemotron-70B-Instructnvidia	1245	3.4K	—	Llama 3.1	74	570
92	Llama-3.1-405B-Instructmeta-llama	1248	27.2K	406B	Llama 3.1	9.2K	607
91	Qwen2.5-72B-InstructQwen	1252	18.8K	72.7B	Custom	192.8K	1,043
90	Llama-4-Scout-17B-16E-Instructmeta-llama	1252	16.8K	109B	Llama 4	110.7K	1,387
89	DeepSeek-V2.5deepseek-ai	1253	11.7K	236B	Custom	4.5K	750
88	Olmo-3-32B-Thinkallenai	1253	3.4K	32.2B	Apache 2.0	12.2K	177
87	Mistral-Small-3.1-24B-Instruct-2503mistralai	1254	18.5K	24.0B	Apache 2.0	168.4K	1,408
86	granite-4.1-8bibm-granite	1260	2.2K	8.8B	Apache 2.0	98.1K	257
85	granite-4.2-3bibm-granite	1268	1.9K	3.7B	Apache 2.0	38.9K	131
84	gpt-oss-20bopenai	1268	5.9K	20.9B	Apache 2.0	5.9M	5,286
83	Llama-4-Maverick-17B-128E-Instructmeta-llama	1269	20.5K	402B	Llama 4	11.7K	520
82	gemma-3-4b-itgoogle	1273	1.6K	4.3B	Gemma	1M	1,633
81	DeepSeek-V2.5-1210deepseek-ai	1273	3K	236B	Custom	2.1K	275
80	Molmo2-8Ballenai	1274	492	8.7B	Apache 2.0	44.4K	198
79	Olmo-3.1-32B-Instructallenai	1276	7.2K	32.2B	Apache 2.0	20.8K	88
78	gemma-3n-E4B-itgoogle	1285	12K	7.8B	Gemma	12.7K	938
77	Qwen3-30B-A3BQwen	1295	13.8K	30.5B	Apache 2.0	1.1M	982
76	NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16nvidia	1297	15.7K	31.6B	OpenMDW 1.1	1.1M	271
75	Ring-flash-2.0inclusionAI	1299	3.9K	103B	MIT	1.4K	104
74	granite-4.2-8bibm-granite	1300	1.8K	8.8B	Apache 2.0	69.2K	116
73	GLM-4.5Vzai-org	1303	2.8K	108B	MIT	16.2K	726
72	QwQ-32BQwen	1305	12.2K	32.8B	Apache 2.0	32K	2,971
71	MiniMax-M2MiniMaxAI	1313	3.8K	229B	Modified MIT	109.4K	1,514
70	Mistral-Small-3.2-24B-Instruct-2506mistralai	1315	9.9K	24.0B	Apache 2.0	109.2K	644
69	DeepSeek-V3deepseek-ai	1315	8.9K	684B	—	1.6M	4,462
68	Qwen3-32BQwen	1317	1.7K	32.8B	Apache 2.0	3M	791
67	gemma-3-12b-itgoogle	1318	1.5K	12.2B	Gemma	365.8K	908
66	Trinity-Large-Previewarcee-ai	1318	17.3K	399B	OpenMDW 1.1	1.7K	181
65	NVIDIA-Nemotron-3-Nano-30B-A3B-BF16nvidia	1320	9.3K	31.6B	Custom	1.6M	840
64	Trinity-Large-Thinkingarcee-ai	1325	15.9K	399B	OpenMDW 1.1	3.2K	190
63	INTELLECT-3PrimeIntellect	1328	3K	107B	MIT	774	218
62	GLM-4.7-Flashzai-org	1330	7.4K	31.2B	MIT	1M	1,896
61	gemma-3-27b-itgoogle	1334	23.6K	27.4B	Gemma	364.5K	2,066
60	Ling-flash-2.0inclusionAI	1335	3.9K	103B	MIT	4.4K	222
59	MiniMax-M2.5MiniMaxAI	1338	24K	229B	Modified MIT	1.2M	1,529
58	granite-4.2-30bibm-granite	1340	1.9K	29.3B	Apache 2.0	32.9K	140
57	Qwen3-Next-80B-A3B-ThinkingQwen	1343	7.6K	81.3B	Apache 2.0	44.4K	503
56	Qwen3-Coder-480B-A35B-InstructQwen	1345	14.2K	480B	Apache 2.0	58.6K	1,387
55	gpt-oss-120bopenai	1350	17.1K	117B	Apache 2.0	2.4M	5,498
54	NVIDIA-Nemotron-3-Super-120B-A12B-BF16nvidia	1356	4.7K	124B	Custom	1.1M	438
53	DeepSeek-R1deepseek-ai	1356	7.8K	684B	MIT	1.6M	14,439
52	DeepSeek-V3-0324deepseek-ai	1358	23.5K	685B	MIT	153.8K	3,223
51	GLM-4.6Vzai-org	1359	1.7K	108B	MIT	5.5K	398
50	GLM-4.5-Airzai-org	1366	17.4K	110B	MIT	1.3M	649
49	Qwen3-30B-A3B-Instruct-2507Qwen	1372	13.6K	30.5B	Apache 2.0	932.4K	855
48	Qwen3-VL-235B-A22B-ThinkingQwen	1377	4.4K	236B	Apache 2.0	81K	420
47	Qwen3.5-35B-A3BQwen	1378	16.9K	36.0B	Apache 2.0	1.6M	1,555
46	MiniMax-M2.7MiniMaxAI	1383	53.7K	229B	Custom	307.1K	1,261
45	Muse-Glimmer-30Bmeta-models	1384	2.3K	29.8B	Apache 2.0	187.5K	2,127
44	Qwen3-235B-A22BQwen	1384	20.8K	235B	Apache 2.0	308.9K	1,128
43	NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16nvidia	1384	2.6K	124B	OpenMDW 1.1	70.3K	116
42	Step-3.5-Flashstepfun-ai	1385	35K	199B	Apache 2.0	219K	847
41	Hy3-previewtencent	1390	3.5K	299B	Custom	68.3K	314
40	Qwen3.5-27BQwen	1390	15.9K	27.8B	Apache 2.0	1.7M	1,090
39	MiMo-V2-FlashXiaomiMiMo	1392	28.1K	310B	MIT	22.2K	756
38	Qwen3-235B-A22B-Thinking-2507Qwen	1397	4.9K	235B	Apache 2.0	8.9K	419
37	DeepSeek-V3.1deepseek-ai	1400	6.8K	685B	MIT	262.8K	864
36	Qwen3.5-122B-A10BQwen	1400	16.5K	125B	Apache 2.0	924.6K	653
35	Inkling-Smallthinkingmachines	1402	23.3K	266B	Apache 2.0	1.2M	449
34	LongCat-Flash-Chatmeituan-longcat	1404	6.4K	562B	MIT	13.3K	540
33	DeepSeek-V3.2-Expdeepseek-ai	1404	6.9K	685B	MIT	43.6K	1,027
32	Qwen3-VL-235B-A22B-InstructQwen	1404	6.4K	236B	Apache 2.0	327K	431
31	MiMo-V2.5XiaomiMiMo	1405	25.9K	311B	MIT	110.3K	434
30	Mistral-Medium-3.5-128Bmistralai	1405	6.1K	128B	Custom	17.2K	498
29	Qwen3-Next-80B-A3B-InstructQwen	1407	13K	81.3B	Apache 2.0	129.9K	1,072
28	DeepSeek-V3.1-Terminusdeepseek-ai	1408	2K	685B	MIT	9.5K	386
27	DeepSeek-V3.2deepseek-ai	1409	28.5K	685B	MIT	7.5M	1,596
26	Qwen3-235B-A22B-Instruct-2507Qwen	1409	57K	235B	Apache 2.0	84.8K	814
25	Beam-1.0-501B-A23Breflection	1411	2.7K	501B	Apache 2.0	11.8K	311
24	DeepSeek-R1-0528deepseek-ai	1412	10K	685B	MIT	122.3K	2,495
23	Mistral-Large-3-675B-Instruct-2512mistralai	1414	52.9K	—	Apache 2.0	2.5K	261
22	MiniMax-M3MiniMaxAI	1415	43.5K	427B	Custom	155.9K	1,600
21	GLM-4.5zai-org	1417	13.7K	358B	MIT	110.4K	1,439
20	GLM-4.7zai-org	1417	7.2K	358B	MIT	66.6K	2,077
19	DeepSeek-V4-Flashdeepseek-ai	1419	28.8K	291B	MIT	1.1M	2,378
18	gemma-4-26B-A4Bgoogle	1422	3.8K	25.8B	Apache 2.0	74.1K	465
17	Qwen3.8-27BQwen	1424	20.4K	27.8B	Apache 2.0	7.8M	19,348
16	GLM-4.6zai-org	1426	20.4K	357B	MIT	28.1K	1,247
15	NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16nvidia	1427	6.2K	561B	OpenMDW 1.1	1.1M	384
14	Hy3tencent	1428	9.5K	299B	Apache 2.0	1.2M	990
13	Qwen3.5-397B-A17BQwen	1430	56K	403B	Apache 2.0	857.2K	1,581
12	gemma-4-31Bgoogle	1430	3.8K	31.3B	Apache 2.0	57K	589
11	GLM-5zai-org	1430	16.3K	754B	MIT	1.4M	2,141
10	Kimi-K2.5moonshotai	1432	42.9K	1.0T	Modified MIT	395K	2,901
9	Inklingthinkingmachines	1436	29.9K	952B	Apache 2.0	1.8M	1,842
8	DeepSeek-V4-Prodeepseek-ai	1439	32.2K	1.6T	MIT	335.6K	5,699
7	Kimi-K2.6moonshotai	1446	21.8K	1.0T	Modified MIT	237.2K	1,641
6	MiMo-V2.5-ProXiaomiMiMo	1448	45.5K	1.0T	MIT	9.9K	771
5	GLM-5.1zai-org	1448	39.5K	754B	MIT	892.7K	1,850
4	GLM-5.2zai-org	1458	32.9K	753B	MIT	318.5K	5,205
3	GLM-5.3zai-org	1463	18.6K	753B	Custom	2.1M	2,395
2	GLM-5.3-Flashzai-org	1463	31.8K	321B	MIT	6.4M	3,088
1	Kimi-K3moonshotai	1466	25.6K	2.8T	Custom	771.6K	11,950

Show the top 20

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.