Leaderboard
Real benchmarks from real hardware. Compare local LLM performance across different setups. Run the command below to contribute yours.
$
npm install -g metrillm@latest$
metrillmRequires Node 20+ and Ollama or LM Studio running
Or run without installing: npx metrillm@latest
Trending
Last 7 days- 1 qwen3:0.6b 1
- 2 deepseek-r1:1.5b 1
- 3 qwen3.5:0.8b 1
- 4 qwen3.5:2b 1
- 5 qwen3:8b 1
- 1 LENOVO 20L7CTO1WW 4
- 2 ASUS 3
- 3 HP HP Z8 G4 Workstation 2
- 1 Intel Core™ i5-8350U 4
- 2 AMD Ryzen 5 5500 3
- 3 Intel Xeon® Gold 6230 2
Benchmarks
272
total runs
Models
187
unique models
Families
44
model families
Hardware
20
unique CPUs
Filters
272 results
| # | CPU | Model | Size | RAM | Runtime | tok/s | TTFT | HW Fit | Quality | Global | Flags | Verdict | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Apple M2 Max | qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-mlx | 30B/MXFP4 | 96 GB | LM-STUDIOMLX | 79.6 | 1.7 s | 95 | 98 | 97 | THINK | Excellent | ||
| 2 | Apple M4 Pro | gpt-oss-20b | — | 64 GB | LM-STUDIOGGUF | 118.2 | 2.2 s | 94 | 95 | 95 | THINK | Excellent | ||
| 3 | Apple M2 Max | qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-mlx | 30B/MXFP4 | 96 GB | LM-STUDIOMLX | 80.4 | 1.8 s | 94 | 96 | 95 | THINK | Excellent | ||
| 4 | Intel Core™ Ultra 9 285K | gpt-oss:20b | 20.9B/MXFP4 | 47 GB | OLLAMAGGUF | 239.9 | 616 ms | 98 | 94 | 95 | THINK | Excellent | ||
| 5 | Apple M4 | openai/gpt-oss-20b | 20B/MXFP4 | 24 GB | LM-STUDIOMLX | 29.3 | 1.8 s | 99 | 93 | 95 | THINK | Excellent | ||
| 6 | Apple M4 | openai/gpt-oss-20b | 20B/MXFP4 | 32 GB | LM-STUDIOMLX | 40.7 | 1.3 s | 100 | 92 | 94 | THINK | Excellent | ||
| 7 | Apple M4 | qwen/qwen3-30b-a3b-2507 | 30B/4bit | 32 GB | LM-STUDIOMLX | 44.8 | 405 ms | 100 | 91 | 94 | Excellent | |||
| 8 | Apple M4 Pro | nemotron-3-nano | — | 64 GB | LM-STUDIOGGUF | 93.3 | 257 ms | 100 | 90 | 93 | THINK | Excellent | ||
| 9 | AMD RYZEN AI MAX+ 395 | gpt-oss:20b | 20.9B/MXFP4 | 125 GB | OLLAMAGGUF | 47.1 | 1.8 s | 85 | 96 | 93 | ECOTHINK | Excellent | ||
| 10 | AMD Ryzen 5 5500 | qwen/qwen3-vl-30b | 30B/Q4_K_M | 31 GB | LM-STUDIOGGUF | 24.8 | 735 ms | 95 | 90 | 92 | Excellent | |||
| 11 | Intel Core™ Ultra 9 285K | qwen3-coder:30b | 30.5B/Q4_K_M | 47 GB | OLLAMAGGUF | 207.9 | 513 ms | 96 | 87 | 90 | Excellent | |||
| 12 | AMD Ryzen 5 5500 | openai/gpt-oss-20b | 20B/MXFP4 | 31 GB | LM-STUDIOGGUF | 58.7 | 4.5 s | 88 | 91 | 90 | THINK | Excellent | ||
| 13 | Apple M4 | unsloth/gemma-4-26b-a4b-it | 26B/Q3_K_M | 24 GB | LM-STUDIOGGUF | 24.9 | 817 ms | 85 | 92 | 90 | Excellent | |||
| 14 | Apple M1 Max | qwen3:14b | 14.8B/Q4_K_M | 32 GB | OLLAMAGGUF | 24.0 | 300 ms | 97 | 87 | 90 | Excellent | |||
| 15 | AMD RYZEN AI MAX+ 395 | nemotron-3-nano:latest | 31.6B/Q4_K_M | 125 GB | OLLAMAGGUF | 65.2 | 295 ms | 100 | 84 | 89 | Excellent | |||
| 16 | AMD RYZEN AI MAX+ 395 | gemma4:26b | 25.8B/Q4_K_M | 125 GB | OLLAMAGGUF | 48.3 | 346 ms | 95 | 87 | 89 | Excellent | |||
| 17 | Apple M4 Pro | qwen/qwen3-8b | 8B/4bit | 64 GB | LM-STUDIOMLX | 33.4 | 257 ms | 95 | 87 | 89 | THINK | Excellent | ||
| 18 | AMD RYZEN AI MAX+ 395 | lfm2:24b | 23.8B/Q4_K_M | 125 GB | OLLAMAGGUF | 95.4 | 202 ms | 100 | 83 | 88 | Excellent | |||
| 19 | AMD RYZEN AI MAX+ 395 | qwen3.6:35b-a3b | 36.0B/Q4_K_M | 125 GB | OLLAMAGGUF | 43.3 | 291 ms | 91 | 87 | 88 | ECO | Excellent | ||
| 20 | AMD RYZEN AI MAX+ 395 | lfm2:24b | 23.8B/Q4_K_M | 125 GB | OLLAMAGGUF | 85.3 | 123 ms | 100 | 83 | 88 | Excellent |
...
Don't miss new benchmarks
Get notified when new models and hardware configurations are tested. No spam, unsubscribe anytime.