Ran it, or it didn’t happen.

Benchmark open models on your own hardware. Runs count once their event log checks out.

Run your first benchmark

Cloud leaderboard

Every model runs on the same pinned machine. 17 models, 70 runs.

Machine
NVIDIA L40S · 48 GB
Engine
ollama 0.40.14
#ModelPass rate
1Qwen3.5-35B-A3BQ4_K_M96%
2Qwen3.5-27BQ4_K_M93%
3Qwen3-30B-A3B-Instruct-2507Q4_K_M92%
4GLM-4.7-FlashQ4_K_M89%
5Qwen3-Coder-30B-A3B-InstructQ4_K_M89%
6Qwen3-8BQ4_K_M89%
7Qwen3-14BQ4_K_M87%
8gemma-3-27b-itQ4_K_M86%
9gpt-oss-20bMXFP485%
10gemma-3-4b-itQ4_K_M83%
11Qwen3.5-2BQ4_K_M81%
12Qwen3-4BQ4_K_M78%
13gemma-3-12b-itQ4_K_M75%
14Llama-3.1-8B-InstructQ4_K_M71%
15Phi-3.5-mini-instructQ4_K_M64%
16MiniCPM5-2BQ4_K_M52%
17Mistral-7B-Instruct-v0.2Q4_K_M47%

Ranked by checks passed. A task a model can’t do is shown, not counted as a zero.

Open model leaderboard

143 open-weight models in creative writing ranked by LMArena score · updated Oct 28, 2026

#ModelScore
143Qwen1.5-4B-ChatQwen969
142gemma-2b-itgoogle986
141OLMo-7B-Instructallenai989
140gemma-1.1-2b-itgoogle998
139gemma-7b-itgoogle1023
138Phi-3-mini-128k-instructmicrosoft1024
137Qwen-14B-ChatQwen1027
136Llama-3.2-1B-Instructmeta-llama1032
135Llama-2-7b-chat-hfmeta-llama1033
134Qwen1.5-7B-ChatQwen1034
133Phi-3-mini-4k-instructmicrosoft1044
132granite-3.0-2b-instructibm-granite1046
131Llama-2-13b-chat-hfmeta-llama1047
130gemma-1.1-7b-itgoogle1059
129deepseek-llm-67b-chatdeepseek-ai1067
128Mistral-7B-Instruct-v0.2mistralai1067
127granite-3.0-8b-instructibm-granite1070
126Llama-2-70b-chat-hfmeta-llama1075
125Phi-3-small-8k-instructmicrosoft1083
124Qwen1.5-32B-ChatQwen1083
Show all 143 models

Scores: LMArena, CC BY 4.0. Measured on served versions, not local builds. A model with several served variants shows its best.