Verified run· 2 of 3 tasks regraded from the event log; coding tasks not regraded
gpt-oss-20b MXFP4
suite-standard@1.0 · run by Kwame Mensah · Oct 5, 2026
- Pass rate
- 100%
- 9 of 9 checks
- Speed
- 188.2 tok/s
- decode, short prompt
- At 8k context
- 161.9 tok/s
- decode
- First token
- 46.3 ms
- short prompt
Tasks
Each task runs 3 times and is graded by a program, not by another model.
Codingcode-intervals
Writes a Python function. Unit tests decide the pass.
3/3Not regradedTool usetool-flight
Calls a flight-search tool. The arguments have to be right.
3/3Regraded from logLong contextneedle-8k
Finds one fact hidden in about 8K tokens of text.
3/3Regraded from log
A community run on the creator’s own machine. It counts toward their profile, not toward headline numbers.
PassedFailedNot supported
Against BenchClub cloud
The same model and suite on the pinned NVIDIA L40S · 48 GB, across 3 cloud runs.
Pass rate
This run100%Cloud85%
Speed
This run188.2 tok/sCloud173.8 tok/s
1.08× the cloud’s speed