Ran it, or it didn’t happen.

Benchmark open models on your own hardware. Runs count once their event log checks out.

Run your first benchmark

Cloud leaderboard

Every model runs on the same pinned machine. 17 models, 70 runs.

Machine
NVIDIA L40S · 48 GB
Engine
ollama 0.40.14
#ModelPass rate
1Qwen3.5-35B-A3BQ4_K_M96%
2Qwen3.5-27BQ4_K_M93%
3Qwen3-30B-A3B-Instruct-2507Q4_K_M92%
4GLM-4.7-FlashQ4_K_M89%
5Qwen3-Coder-30B-A3B-InstructQ4_K_M89%
6Qwen3-8BQ4_K_M89%
7Qwen3-14BQ4_K_M87%
8gemma-3-27b-itQ4_K_M86%
9gpt-oss-20bMXFP485%
10gemma-3-4b-itQ4_K_M83%
11Qwen3.5-2BQ4_K_M81%
12Qwen3-4BQ4_K_M78%
13gemma-3-12b-itQ4_K_M75%
14Llama-3.1-8B-InstructQ4_K_M71%
15Phi-3.5-mini-instructQ4_K_M64%
16MiniCPM5-2BQ4_K_M52%
17Mistral-7B-Instruct-v0.2Q4_K_M47%

Ranked by checks passed. A task a model can’t do is shown, not counted as a zero.

Open model leaderboard

144 open-weight models ranked by LMArena score · updated Oct 28, 2026

#ModelScore
144Qwen1.5-4B-ChatQwen997
143gemma-2b-itgoogle1002
142gemma-1.1-2b-itgoogle1022
141OLMo-7B-Instructallenai1032
140Phi-3-mini-128k-instructmicrosoft1050
139Qwen-14B-ChatQwen1051
138Llama-2-7b-chat-hfmeta-llama1053
137Llama-3.2-1B-Instructmeta-llama1055
136gemma-7b-itgoogle1056
135granite-3.0-2b-instructibm-granite1080
134Phi-3-mini-4k-instructmicrosoft1080
133SOLAR-10.7B-Instruct-v1.0upstage1083
132Qwen1.5-7B-ChatQwen1083
131Llama-2-13b-chat-hfmeta-llama1084
130Mistral-7B-Instruct-v0.2mistralai1090
129gemma-1.1-7b-itgoogle1094
128granite-3.0-8b-instructibm-granite1096
127deepseek-llm-67b-chatdeepseek-ai1105
126Llama-3.2-3B-Instructmeta-llama1110
125Phi-3-small-8k-instructmicrosoft1110
Show all 144 models

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.