Ran it, or it didn’t happen.

Benchmark open models on your own hardware. Runs count once their event log checks out.

Run your first benchmark

Cloud leaderboard

Every model runs on the same pinned machine. 17 models, 70 runs.

Machine
NVIDIA L40S · 48 GB
Engine
ollama 0.40.14
#ModelPass rate
1Qwen3.5-35B-A3BQ4_K_M96%
2Qwen3.5-27BQ4_K_M93%
3Qwen3-30B-A3B-Instruct-2507Q4_K_M92%
4GLM-4.7-FlashQ4_K_M89%
5Qwen3-Coder-30B-A3B-InstructQ4_K_M89%
6Qwen3-8BQ4_K_M89%
7Qwen3-14BQ4_K_M87%
8gemma-3-27b-itQ4_K_M86%
9gpt-oss-20bMXFP485%
10gemma-3-4b-itQ4_K_M83%
11Qwen3.5-2BQ4_K_M81%
12Qwen3-4BQ4_K_M78%
13gemma-3-12b-itQ4_K_M75%
14Llama-3.1-8B-InstructQ4_K_M71%
15Phi-3.5-mini-instructQ4_K_M64%
16MiniCPM5-2BQ4_K_M52%
17Mistral-7B-Instruct-v0.2Q4_K_M47%

Ranked by checks passed. A task a model can’t do is shown, not counted as a zero.

Open model leaderboard

143 open-weight models in coding ranked by LMArena score · updated Oct 28, 2026

#ModelScore
143Qwen1.5-4B-ChatQwen999
142Llama-2-7b-chat-hfmeta-llama1002
141gemma-2b-itgoogle1009
140OLMo-7B-Instructallenai1015
139gemma-1.1-2b-itgoogle1034
138Phi-3-mini-128k-instructmicrosoft1039
137gemma-7b-itgoogle1048
136Llama-2-13b-chat-hfmeta-llama1062
135SOLAR-10.7B-Instruct-v1.0upstage1067
134Llama-3.2-1B-Instructmeta-llama1070
133Qwen-14B-ChatQwen1071
132Llama-2-70b-chat-hfmeta-llama1078
131Mistral-7B-Instruct-v0.2mistralai1081
130gemma-1.1-7b-itgoogle1083
129granite-3.0-2b-instructibm-granite1090
128Phi-3-mini-4k-instructmicrosoft1093
127deepseek-llm-67b-chatdeepseek-ai1095
126Llama-3.2-3B-Instructmeta-llama1097
125Phi-3-small-8k-instructmicrosoft1101
124Qwen1.5-7B-ChatQwen1107
Show all 143 models

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.