Ran it, or it didn’t happen.

Benchmark open models on your own hardware. Runs count once their event log checks out.

Run your first benchmark

Cloud leaderboard

Every model runs on the same pinned machine. 17 models, 70 runs.

Machine
NVIDIA L40S · 48 GB
Engine
ollama 0.40.14
#ModelPass rate
1Qwen3.5-35B-A3BQ4_K_M96%
2Qwen3.5-27BQ4_K_M93%
3Qwen3-30B-A3B-Instruct-2507Q4_K_M92%
4GLM-4.7-FlashQ4_K_M89%
5Qwen3-Coder-30B-A3B-InstructQ4_K_M89%
6Qwen3-8BQ4_K_M89%
7Qwen3-14BQ4_K_M87%
8gemma-3-27b-itQ4_K_M86%
9gpt-oss-20bMXFP485%
10gemma-3-4b-itQ4_K_M83%
11Qwen3.5-2BQ4_K_M81%
12Qwen3-4BQ4_K_M78%
13gemma-3-12b-itQ4_K_M75%
14Llama-3.1-8B-InstructQ4_K_M71%
15Phi-3.5-mini-instructQ4_K_M64%
16MiniCPM5-2BQ4_K_M52%
17Mistral-7B-Instruct-v0.2Q4_K_M47%

Ranked by checks passed. A task a model can’t do is shown, not counted as a zero.

Open model leaderboard

135 open-weight models in expert ranked by LMArena score · updated Oct 28, 2026

#ModelScore
135gemma-1.1-2b-itgoogle970
134Qwen1.5-4B-ChatQwen980
133Phi-3-mini-128k-instructmicrosoft984
132gemma-7b-itgoogle1001
131Llama-3.2-1B-Instructmeta-llama1007
130Llama-2-13b-chat-hfmeta-llama1030
129Mistral-7B-Instruct-v0.2mistralai1036
128Llama-2-7b-chat-hfmeta-llama1036
127Llama-2-70b-chat-hfmeta-llama1039
126gemma-1.1-7b-itgoogle1039
125Phi-3-mini-4k-instructmicrosoft1051
124Qwen1.5-7B-ChatQwen1055
123granite-3.0-2b-instructibm-granite1064
122Phi-3-small-8k-instructmicrosoft1067
121granite-3.0-8b-instructibm-granite1087
120Mixtral-8x7B-Instruct-v0.1mistralai1087
119Llama-3.2-3B-Instructmeta-llama1090
118Qwen1.5-14B-ChatQwen1094
117gemma-2-2b-itgoogle1096
116Phi-3-medium-4k-instructmicrosoft1108
Show all 135 models

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.