Ran it, or it didn’t happen.

Benchmark open models on your own hardware. Runs count once their event log checks out.

Run your first benchmark

Cloud leaderboard

Every model runs on the same pinned machine. 17 models, 70 runs.

Machine
NVIDIA L40S · 48 GB
Engine
ollama 0.40.14
#ModelPass rate
1Qwen3.5-35B-A3BQ4_K_M96%
2Qwen3.5-27BQ4_K_M93%
3Qwen3-30B-A3B-Instruct-2507Q4_K_M92%
4GLM-4.7-FlashQ4_K_M89%
5Qwen3-Coder-30B-A3B-InstructQ4_K_M89%
6Qwen3-8BQ4_K_M89%
7Qwen3-14BQ4_K_M87%
8gemma-3-27b-itQ4_K_M86%
9gpt-oss-20bMXFP485%
10gemma-3-4b-itQ4_K_M83%
11Qwen3.5-2BQ4_K_M81%
12Qwen3-4BQ4_K_M78%
13gemma-3-12b-itQ4_K_M75%
14Llama-3.1-8B-InstructQ4_K_M71%
15Phi-3.5-mini-instructQ4_K_M64%
16MiniCPM5-2BQ4_K_M52%
17Mistral-7B-Instruct-v0.2Q4_K_M47%

Ranked by checks passed. A task a model can’t do is shown, not counted as a zero.

Open model leaderboard

144 open-weight models in instructions ranked by LMArena score · updated Oct 28, 2026

#ModelScore
144gemma-2b-itgoogle970
143OLMo-7B-Instructallenai978
142Qwen1.5-4B-ChatQwen978
141gemma-1.1-2b-itgoogle992
140Llama-2-7b-chat-hfmeta-llama1006
139gemma-7b-itgoogle1017
138Phi-3-mini-128k-instructmicrosoft1023
137Llama-3.2-1B-Instructmeta-llama1031
136Qwen-14B-ChatQwen1031
135Llama-2-13b-chat-hfmeta-llama1045
134SOLAR-10.7B-Instruct-v1.0upstage1046
133granite-3.0-2b-instructibm-granite1055
132gemma-1.1-7b-itgoogle1057
131Phi-3-mini-4k-instructmicrosoft1058
130Qwen1.5-7B-ChatQwen1058
129Mistral-7B-Instruct-v0.2mistralai1060
128Llama-2-70b-chat-hfmeta-llama1071
127deepseek-llm-67b-chatdeepseek-ai1079
126Phi-3-small-8k-instructmicrosoft1086
125granite-3.0-8b-instructibm-granite1088
Show all 144 models

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.