Ran it, or it didn’t happen.

Benchmark open models on your own hardware. Runs count once their event log checks out.

Recent verified runsWhereSpeed

PassedFailedNot supported

Cloud leaderboard

Every model runs on the same pinned machine. 17 models, 70 runs.

#	Model	Pass rate				Speed	Runs
1	Qwen3.5-35B-A3BQ4_K_M	96%	9/9	8/9	9/9	201.4 tok/s	3
2	Qwen3.5-27BQ4_K_M	93%	8/9	9/9	8/9	35.5 tok/s	3
3	Qwen3-30B-A3B-Instruct-2507Q4_K_M	92%	11/12	10/12	12/12	187.6 tok/s	4
4	GLM-4.7-FlashQ4_K_M	89%	9/9	6/9	9/9	201.7 tok/s	3
5	Qwen3-Coder-30B-A3B-InstructQ4_K_M	89%	9/9	7/9	8/9	186.4 tok/s	3
6	Qwen3-8BQ4_K_M	89%	9/12	11/12	12/12	120.7 tok/s	4
7	Qwen3-14BQ4_K_M	87%	13/15	11/15	15/15	67.1 tok/s	5
8	gemma-3-27b-itQ4_K_M	86%	17/18	Not supported	14/18	36.2 tok/s	6
9	gpt-oss-20bMXFP4	85%	9/9	9/9	5/9	173.8 tok/s	3
10	gemma-3-4b-itQ4_K_M	83%	11/15	Not supported	14/15	232.7 tok/s	5
11	Qwen3.5-2BQ4_K_M	81%	9/12	9/12	11/12	298.1 tok/s	4
12	Qwen3-4BQ4_K_M	78%	6/9	6/9	9/9	247.9 tok/s	3
13	gemma-3-12b-itQ4_K_M	75%	8/12	Not supported	10/12	80.9 tok/s	4
14	Llama-3.1-8B-InstructQ4_K_M	71%	8/15	9/15	15/15	124.4 tok/s	5
15	Phi-3.5-mini-instructQ4_K_M	64%	9/18	Not supported	14/18	261.3 tok/s	6
16	MiniCPM5-2BQ4_K_M	52%	4/9	3/9	7/9	301.4 tok/s	3
17	Mistral-7B-Instruct-v0.2Q4_K_M	47%	6/18	Not supported	11/18	137.1 tok/s	6

Ranked by checks passed. A task a model can’t do is shown, not counted as a zero.

144 open-weight models in hard prompts ranked by LMArena score · updated Nov 6, 2026

#	Model	Score	Votes	Params	License	Downloads	Likes
144	Qwen1.5-4B-ChatQwen	976	2.1K	4.0B	Custom	15.9K	53
143	gemma-2b-itgoogle	989	1.2K	2.5B	Gemma	14K	975
142	OLMo-7B-Instructallenai	993	1.5K	6.9B	Apache 2.0	846	54
141	gemma-1.1-2b-itgoogle	1005	3.2K	2.5B	Gemma	6.1K	175
140	Llama-2-7b-chat-hfmeta-llama	1009	3.3K	6.7B	Llama 2	126.4K	4,951
139	Qwen-14B-ChatQwen	1027	1K	14.2B	—	5.2K	381
138	Phi-3-mini-128k-instructmicrosoft	1028	6.2K	3.8B	MIT	238.7K	1,713
137	gemma-7b-itgoogle	1041	2.3K	8.5B	Gemma	25.3K	1,263
136	Llama-3.2-1B-Instructmeta-llama	1044	2.2K	1.2B	Llama 3.2	1.5M	1,961
135	Llama-2-13b-chat-hfmeta-llama	1051	4.5K	13.0B	Llama 2	148.8K	1,138
134	SOLAR-10.7B-Instruct-v1.0upstage	1062	932	10.7B	CC BY-NC 4.0	48.7K	660
133	Qwen1.5-7B-ChatQwen	1065	1.3K	7.7B	Tongyi Qianwen	7K	192
132	Mistral-7B-Instruct-v0.2mistralai	1067	5.2K	7.2B	Apache 2.0	1.6M	3,280
131	deepseek-llm-67b-chatdeepseek-ai	1070	1.1K	—	Custom	2.8K	222
130	gemma-1.1-7b-itgoogle	1070	7K	8.5B	Gemma	4.2K	276
129	Llama-2-70b-chat-hfmeta-llama	1073	9.7K	69.0B	Llama 2	4.8K	2,211
128	granite-3.0-2b-instructibm-granite	1073	1.7K	2.6B	Apache 2.0	3.2K	48
127	Phi-3-mini-4k-instructmicrosoft	1087	3.2K	3.8B	MIT	329.2K	1,489
126	granite-3.0-8b-instructibm-granite	1091	1.7K	8.2B	Apache 2.0	13.3K	209
125	Llama-3.2-3B-Instructmeta-llama	1094	2.2K	3.2B	Llama 3.2	914.1K	2,963

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.