Verified run· 2 of 3 tasks regraded from the event log; coding tasks not regraded

MiniCPM5-2B Q4_K_M

suite-standard@1.0 · run by ghost_gpu · Sep 12, 2026

Pass rate
67%
6 of 9 checks
Speed
248.9 tok/s
decode, short prompt
At 8k context
194.2 tok/s
decode
First token
51.6 ms
short prompt

Tasks

Each task runs 3 times and is graded by a program, not by another model.

  • Codingcode-intervals

    Writes a Python function. Unit tests decide the pass.

    1/3Not regraded
  • Tool usetool-flight

    Calls a flight-search tool. The arguments have to be right.

    3/3Regraded from log
  • Long contextneedle-8k

    Finds one fact hidden in about 8K tokens of text.

    2/3Regraded from log

A community run on the creator’s own machine. It counts toward their profile, not toward headline numbers.

PassedFailedNot supported

Against BenchClub cloud

The same model and suite on the pinned NVIDIA L40S · 48 GB, across 3 cloud runs.

Pass rate

This run67%Cloud52%

Speed

This run248.9 tok/sCloud301.4 tok/s

0.83× the cloud’s speed

Other runs of this model

All runs