Leaderboard
Real benchmarks from real hardware. Compare local LLM performance across different setups. Run the command below to contribute yours.
$
npm install -g metrillm@latest$
metrillmRequires Node 20+ and Ollama or LM Studio running
Or run without installing: npx metrillm@latest
Trending
Last 7 days- 1 qwen3.5:4b 4
- 2 hf.co/unsloth/Qwen3.8-27B-GGUF:UD-IQ1_S 3
- 3 maternion/ling-3.0-tiny:8b 3
- 4 qwen3.5:4b-mlx 3
- 5 gemma4:e4b 2
- 1 MacBook Pro 47
- 2 GMKtec NucBox EVO-T2S 6
- 3 LENOVO 20U30029MB 5
- 4 Micro-Star International Co., Ltd. MS-7E51 3
- 5 Mac mini 2
- 1 Apple M1 Pro 46
- 2 Intel Core™ Ultra X7 358H 6
- 3 Intel Core™ i5-10210U 5
- 4 AMD Ryzen 7 9700X 8-Core Processor 3
- 5 Apple M2 2
Benchmarks
500
total runs
Models
279
unique models
Families
44
model families
Hardware
49
unique CPUs
Filters
500 results
| # | CPU | Model | Size | RAM | Runtime | tok/s | TTFT | HW Fit | Quality | Global | Flags | Verdict | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Apple M2 Max | qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-mlx | 30B/MXFP4 | 96 GB | LM-STUDIOMLX | 79.6 | 1.7 s | 95 | 98 | 97 | THINK | Excellent | ||
| 2 | Apple M4 Max | qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-mlx | 30B/MXFP4 | 128 GB | LM-STUDIOMLX | 112.8 | 1.5 s | 95 | 96 | 96 | THINK | Excellent | ||
| 3 | AMD RYZEN AI MAX+ 395 | nemotron3:33b | 33.0B/Q4_K_M | 125 GB | OLLAMAGGUF | 62.7 | 1.0 s | 95 | 97 | 96 | ECOTHINK | Excellent | ||
| 4 | Apple M4 Pro | gpt-oss-20b | — | 64 GB | LM-STUDIOGGUF | 118.2 | 2.2 s | 94 | 95 | 95 | THINK | Excellent | ||
| 5 | Apple M2 Max | qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-mlx | 30B/MXFP4 | 96 GB | LM-STUDIOMLX | 80.4 | 1.8 s | 94 | 96 | 95 | THINK | Excellent | ||
| 6 | Intel Core™ Ultra 9 285K | gpt-oss:20b | 20.9B/MXFP4 | 47 GB | OLLAMAGGUF | 239.9 | 616 ms | 98 | 94 | 95 | THINK | Excellent | ||
| 7 | Apple M4 | openai/gpt-oss-20b | 20B/MXFP4 | 24 GB | LM-STUDIOMLX | 29.3 | 1.8 s | 99 | 93 | 95 | THINK | Excellent | ||
| 8 | Cortex-X925 | gemma4:26b | 25.8B/Q4_K_M | 122 GB | OLLAMAGGUF | 67.4 | 529 ms | 100 | 92 | 94 | Excellent | |||
| 9 | Intel Xeon® E5-2637 v3 | qwen3-30b-a3b-t16-c32k-instruct:latest | 30.5B/Q4_K_M | 96 GB | OLLAMAGGUF | 116.0 | 575 ms | 100 | 91 | 94 | Excellent | |||
| 10 | Intel Core™ i7-14700F | GPT-20B:20b | 20.9B/MXFP4 | 64 GB | OLLAMAGGUF | 181.0 | 1.3 s | 96 | 93 | 94 | THINK | Excellent | ||
| 11 | Apple M4 Pro | gpt-oss:20b | 20.9B/MXFP4 | 48 GB | OLLAMAGGUF | 54.5 | 2.9 s | 92 | 95 | 94 | THINK | Excellent | ||
| 12 | Apple M4 | openai/gpt-oss-20b | 20B/MXFP4 | 32 GB | LM-STUDIOMLX | 40.7 | 1.3 s | 100 | 92 | 94 | THINK | Excellent | ||
| 13 | Apple M4 | qwen/qwen3-30b-a3b-2507 | 30B/4bit | 32 GB | LM-STUDIOMLX | 44.8 | 405 ms | 100 | 91 | 94 | Excellent | |||
| 14 | AMD RYZEN AI MAX+ 395 | gpt-oss:20b | 20.9B/MXFP4 | 64 GB | OLLAMAGGUF | 48.0 | 2.3 s | 91 | 95 | 94 | THINK | Excellent | ||
| 15 | Cortex-X925 | gpt-oss:20b | 20.9B/MXFP4 | 122 GB | OLLAMAGGUF | 60.5 | 3.1 s | 87 | 95 | 93 | THINK | Excellent | ||
| 16 | Apple M4 Pro | nemotron-3-nano | — | 64 GB | LM-STUDIOGGUF | 93.3 | 257 ms | 100 | 90 | 93 | THINK | Excellent | ||
| 17 | AMD Ryzen 7 9700X 8-Core Processor | google/gemma-4-26b-a4b-qat | 26B/Q4_0 | 31 GB | LM-STUDIOGGUF | 109.7 | 156 ms | 96 | 92 | 93 | Excellent | |||
| 18 | Intel Core™ i7-14700F | GPT-OSS-20B:20b | 20.9B/MXFP4 | 128 GB | OLLAMAGGUF | 178.6 | 1.4 s | 92 | 93 | 93 | THINK | Excellent | ||
| 19 | AMD Ryzen 7 7800X3D 8-Core Processor | gemma-4-26b-a4b-it-qat | 26B/Q4_K_XL | 31 GB | LM-STUDIOGGUF | 166.9 | 113 ms | 93 | 93 | 93 | ECO | Excellent | ||
| 20 | Intel Core™ i7-14700F | GPT-20B:20b | 20.9B/MXFP4 | 128 GB | OLLAMAGGUF | 177.5 | 1.2 s | 93 | 93 | 93 | THINK | Excellent |
...
Don't miss new benchmarks
Get notified when new models and hardware configurations are tested. No spam, unsubscribe anytime.