utRTX 3060 TESTS
What actually runs
on 12 GB of VRAM.
Scout’s own test server downloads open models from the Ollama library and times them on one NVIDIA RTX 3060, every morning from 4:00 to 8:30 AM Arizona time. Models that don’t fit in 12 GB still run, partly from system memory, so you can see how much slower that is.
223models timed
163fit in 12 GB
60don’t fit, still ran
20couldn’t run
Oct 31, 2026last updated
The test machine
Compare these with your own computer. When a model fits in VRAM, speed mostly follows the card’s memory bandwidth; when it doesn’t, the processor and system memory set the pace.
- Graphics card
- NVIDIA GeForce RTX 3060
- Video memory (VRAM)
- 12 GB GDDR6360 GB/s · 192-bit bus
- Processor
- Intel Core i5-7600K
- System memory (RAM)
- 32 GB DDR42,133 MT/s
- Software
- Ollama 0.40.13NVIDIA driver 580.178.04 · Ubuntu 26.04 LTS
- Board & storage
- Gigabyte Z270-HD3256 GB SSD for models
223 of 223 tested models · not a quality ranking
| Model | Writing speed | Reading prompt | Fits in 12 GB? | Download | VRAM used | Tested |
|---|---|---|---|---|---|---|
| smollm2:135m ↗134.52M parameters · F16 | 406.5 tok/s | 32,831 tok/s | Fits | 0.3 GB | 0.5 GB | Oct 22, 2026 |
| qwen:0.5b ↗620M parameters · Q4_0 | 357.2 tok/s | 17,033 tok/s | Fits | 0.4 GB | 0.6 GB | Oct 22, 2026 |
| qwen:0.5b-text ↗620M parameters · Q4_0 | 353.8 tok/s | 17,092 tok/s | Fits | 0.4 GB | 0.6 GB | Oct 22, 2026 |
| gemma3:270m-it-qat ↗268.10M parameters · Q4_0 | 347.7 tok/s | 27,626 tok/s | Fits | 0.2 GB | 0.4 GB | Oct 21, 2026 |
| gemma3:270m ↗268.10M parameters · Q8_0 | 340.2 tok/s | 28,000 tok/s | Fits | 0.3 GB | 0.4 GB | Oct 21, 2026 |
| qwen2:0.5b ↗494.03M parameters · Q4_0 | 337.5 tok/s | 21,246 tok/s | Fits | 0.4 GB | 0.5 GB | Oct 22, 2026 |
| functiongemma:latest ↗268.10M parameters · Q8_0 | 336.8 tok/s | 27,783 tok/s | Fits | 0.3 GB | 0.4 GB | Oct 21, 2026 |
| granite4:350m-h ↗340.33M parameters · Q8_0 | 327 tok/s | 5,950 tok/s | Fits | 0.4 GB | 0.5 GB | Oct 22, 2026 |
| tinyllama:latest ↗1B parameters · Q4_0 | 315.1 tok/s | 11,353 tok/s | Fits | 0.6 GB | 0.8 GB | Oct 22, 2026 |
| tinyllama:v0.6 ↗1B parameters · Q4_0 | 313.6 tok/s | 11,343 tok/s | Fits | 0.6 GB | 0.8 GB | Oct 22, 2026 |
| qwen2.5-coder:0.5b ↗494.03M parameters · Q4_K_M | 309.7 tok/s | 20,371 tok/s | Fits | 0.4 GB | 0.6 GB | Oct 21, 2026 |
| qwen2.5:0.5b-base ↗494.03M parameters · Q4_K_M | 298 tok/s | 20,339 tok/s | Fits | 0.4 GB | 0.6 GB | Oct 21, 2026 |
| qwen2.5-coder:0.5b-base ↗494.03M parameters · Q8_0 | 292.4 tok/s | 21,242 tok/s | Fits | 0.5 GB | 0.7 GB | Oct 22, 2026 |
| qwen2.5:0.5b ↗494.03M parameters · Q4_K_M | 292.1 tok/s | 20,371 tok/s | Fits | 0.4 GB | 0.6 GB | Oct 21, 2026 |
| lfm2.5-thinking:latest ↗1.2B parameters · Q4_K_M | 282.2 tok/s | 10,813 tok/s | Fits | 0.7 GB | 0.9 GB | Oct 20, 2026 |
| deepseek-coder:latest ↗1B parameters · Q4_0 | 258 tok/s | 8,205 tok/s | Fits | 0.8 GB | 1.3 GB | Oct 22, 2026 |
| deepseek-coder:base ↗1B parameters · Q4_0 | 256.8 tok/s | 7,333 tok/s | Fits | 0.8 GB | 1.3 GB | Oct 22, 2026 |
| smollm2:360m ↗361.82M parameters · F16 | 252.3 tok/s | 18,465 tok/s | Fits | 0.7 GB | 0.9 GB | Oct 22, 2026 |
| qwen3:0.6b ↗751.63M parameters · Q4_K_M | 247.8 tok/s | 12,620 tok/s | Fits | 0.5 GB | 0.8 GB | Oct 21, 2026 |
| granite4:350m ↗352.38M parameters · BF16 | 240.5 tok/s | 15,228 tok/s | Fits | 0.7 GB | 0.9 GB | Oct 22, 2026 |
| granite3.1-moe:latest ↗3.3B parameters · Q4_K_M | 216.3 tok/s | 7,365 tok/s | Fits | 2.0 GB | 2.2 GB | Oct 22, 2026 |
| qwen:1.8b-text ↗2B parameters · Q4_0 | 215.3 tok/s | 7,680 tok/s | Fits | 1.1 GB | 1.5 GB | Oct 22, 2026 |
| qwen:1.8b ↗2B parameters · Q4_0 | 198.5 tok/s | 7,649 tok/s | Fits | 1.1 GB | 1.5 GB | Oct 22, 2026 |
| lfm3-omni:latest ↗1.7B parameters · Q4_K_M | 198.3 tok/s | 7,864 tok/s | Fits | 2.0 GB | 2.9 GB | Oct 31, 2026 |
| lfm3-audio:latest ↗1.7B parameters · Q4_K_M | 197.7 tok/s | 7,815 tok/s | Fits | 1.7 GB | 2.2 GB | Oct 31, 2026 |
| qwen2:1.5b ↗1.5B parameters · Q4_0 | 197.4 tok/s | 8,656 tok/s | Fits | 0.9 GB | 1.1 GB | Oct 22, 2026 |
| minicpm-v4.6:latest ↗752.16M parameters · Q4_K_M | 196 tok/s | 10,114 tok/s | Fits | 1.6 GB | 1.8 GB | Oct 20, 2026 |
| qwen3-vl:2b ↗2.1B parameters · Q4_K_M | 183.2 tok/s | 7,101 tok/s | Fits | 1.9 GB | 2.8 GB | Oct 22, 2026 |
| falcon3:3b ↗3.2B parameters · Q4_K_M | 183 tok/s | 5,162 tok/s | Fits | 2.0 GB | 2.1 GB | Oct 22, 2026 |
| deepseek-r1:1.5b ↗1.8B parameters · Q4_K_M | 182.8 tok/s | 7,851 tok/s | Fits | 1.1 GB | 1.2 GB | Oct 21, 2026 |
| llama3.2:1b ↗1.2B parameters · Q8_0 | 182.4 tok/s | 11,839 tok/s | Fits | 1.3 GB | 1.5 GB | Oct 21, 2026 |
| qwen3-vl:2b-instruct ↗1.7B parameters · Q4_K_M | 181.3 tok/s | 6,989 tok/s | Fits | 1.9 GB | 2.6 GB | Oct 22, 2026 |
| gemma3:1b ↗999.89M parameters · Q4_K_M | 180.5 tok/s | 10,360 tok/s | Fits | 0.8 GB | 1.0 GB | Oct 21, 2026 |
| qwen2.5:1.5b ↗1.5B parameters · Q4_K_M | 180.5 tok/s | 7,927 tok/s | Fits | 1.0 GB | 1.2 GB | Oct 21, 2026 |
| qwen2.5-coder:1.5b ↗1.5B parameters · Q4_K_M | 180.4 tok/s | 7,945 tok/s | Fits | 1.0 GB | 1.2 GB | Oct 21, 2026 |
| qwen2.5-coder:1.5b-base ↗1.5B parameters · Q4_K_M | 179.4 tok/s | 7,867 tok/s | Fits | 1.0 GB | 1.2 GB | Oct 22, 2026 |
| falcon3:1b ↗1.7B parameters · Q8_0 | 168.6 tok/s | 10,090 tok/s | Fits | 1.8 GB | 1.7 GB | Oct 22, 2026 |
| qwen3:1.7b ↗2.0B parameters · Q4_K_M | 167.6 tok/s | 7,148 tok/s | Fits | 1.4 GB | 1.5 GB | Oct 21, 2026 |
| gemma3:1b-it-qat ↗999.89M parameters · Q4_0 | 167.1 tok/s | 10,858 tok/s | Fits | 1.0 GB | 1.1 GB | Oct 21, 2026 |
| lfm3:latest ↗1.7B parameters · Q4_K_M | 154.8 tok/s | 7,758 tok/s | Fits | 1.1 GB | 1.3 GB | Oct 31, 2026 |
| lfm3-vl:latest ↗1.7B parameters · Q4_K_M | 154.6 tok/s | 7,603 tok/s | Fits | 1.5 GB | 2.0 GB | Oct 31, 2026 |
| gemma:2b-instruct ↗3B parameters · Q4_0 | 154.2 tok/s | 7,183 tok/s | Fits | 1.6 GB | 1.7 GB | Oct 22, 2026 |
| lfm2.5:latest ↗8.5B parameters · Q4_K_M | 153.4 tok/s | 5,520 tok/s | Fits | 5.2 GB | 5.0 GB | Oct 20, 2026 |
| granite4:7b-a1b-h ↗6.9B parameters · Q4_K_M | 153 tok/s | 3,207 tok/s | Fits | 4.2 GB | 4.2 GB | Oct 22, 2026 |
| gemma:2b ↗3B parameters · Q4_0 | 148.1 tok/s | 7,176 tok/s | Fits | 1.7 GB | 1.8 GB | Oct 22, 2026 |
| gemma:2b-text ↗3B parameters · Q4_0 | 145.4 tok/s | 7,110 tok/s | Fits | 1.7 GB | 1.9 GB | Oct 22, 2026 |
| smollm2:latest ↗1.7B parameters · Q8_0 | 142.1 tok/s | 6,497 tok/s | Fits | 1.8 GB | 2.3 GB | Oct 22, 2026 |
| bonsai-2:2b ↗1.9B parameters · Q2_0 | 133.6 tok/s | 6,244 tok/s | Fits | 0.9 GB | 1.3 GB | Oct 20, 2026 |
| granite4:1b-h ↗1.5B parameters · Q8_0 | 132.6 tok/s | 3,331 tok/s | Fits | 1.6 GB | 1.7 GB | Oct 22, 2026 |
| qwen3.5:0.8b ↗752.39M parameters · Q8_0 · Qwen3.5-0.8B profile | 132.2 tok/s | 8,581 tok/s | Fits | 1.2 GB | 1.7 GB | Oct 20, 2026 |
| gemma4:e2b ↗4.6B parameters · Q4_K_M | 123.2 tok/s | 4,296 tok/s | Fits | 4.6 GB | 3.0 GB | Oct 20, 2026 |
| gemma4:e2b-it-qat ↗4.6B parameters · Q4_0 | 123.2 tok/s | 4,988 tok/s | Fits | 4.3 GB | 2.7 GB | Oct 20, 2026 |
| qwen2.5vl:3b ↗3.8B parameters · Q4_K_M | 119.2 tok/s | 4,312 tok/s | Fits | 3.2 GB | 3.8 GB | Oct 22, 2026 |
| gemma2:2b ↗2.6B parameters · Q4_0 | 118.8 tok/s | 5,439 tok/s | Fits | 1.6 GB | 2.0 GB | Oct 21, 2026 |
| llama3.2:latest ↗3.2B parameters · Q4_K_M | 117.7 tok/s | 4,279 tok/s | Fits | 2.0 GB | 2.3 GB | Oct 21, 2026 |
| qwen2.5-coder:3b ↗3.1B parameters · Q4_K_M | 117.4 tok/s | 4,338 tok/s | Fits | 1.9 GB | 2.1 GB | Oct 21, 2026 |
| qwen2.5-coder:3b-base ↗3.1B parameters · Q4_K_M | 116.7 tok/s | 4,275 tok/s | Fits | 1.9 GB | 2.1 GB | Oct 22, 2026 |
| qwen2.5:3b ↗3.1B parameters · Q4_K_M | 116.3 tok/s | 4,319 tok/s | Fits | 1.9 GB | 2.1 GB | Oct 21, 2026 |
| granite4:3b-h ↗3.2B parameters · Q4_K_M | 112.8 tok/s | 2,401 tok/s | Fits | 1.9 GB | 2.1 GB | Oct 22, 2026 |
| granite4:micro ↗3.4B parameters · Q4_K_M | 105.6 tok/s | 3,660 tok/s | Fits | 2.1 GB | 2.3 GB | Oct 22, 2026 |
| cogito:3b ↗3.6B parameters · Q4_K_M | 105.5 tok/s | 4,231 tok/s | Fits | 2.2 GB | 2.3 GB | Oct 22, 2026 |
| granite4:latest ↗3.4B parameters · Q4_K_M | 105.5 tok/s | 3,612 tok/s | Fits | 2.1 GB | 2.3 GB | Oct 22, 2026 |
| granite4.1:3b ↗3.4B parameters · Q4_K_M | 105.2 tok/s | 3,592 tok/s | Fits | 2.1 GB | 2.3 GB | Oct 20, 2026 |
| granite4.2:3b ↗3.7B parameters · Q4_K_M | 105 tok/s | 3,610 tok/s | Fits | 2.2 GB | 2.3 GB | Oct 20, 2026 |
| gemma3n:e2b ↗4.5B parameters · Q4_K_M | 104.9 tok/s | 2,761 tok/s | Fits | 7.8 GB | 3.0 GB | Oct 22, 2026 |
| phi3:latest ↗3.8B parameters · Q4_0 | 103.8 tok/s | 3,657 tok/s | Fits | 2.2 GB | 3.0 GB | Oct 22, 2026 |
| ministral-3:3b ↗3.8B parameters · Q4_K_M | 101 tok/s | 5,385 tok/s | Fits | 3.0 GB | 3.2 GB | Oct 21, 2026 |
| qwen:4b-text ↗4B parameters · Q4_0 | 100.2 tok/s | 3,540 tok/s | Fits | 2.3 GB | 3.0 GB | Oct 22, 2026 |
| qwen:latest ↗4B parameters · Q4_0 | 99.6 tok/s | 3,543 tok/s | Fits | 2.3 GB | 3.0 GB | Oct 22, 2026 |
| nemotron-3-nano:4b ↗4.0B parameters · Q4_K_M | 98.8 tok/s | 2,286 tok/s | Fits | 2.8 GB | 2.8 GB | Oct 21, 2026 |
| bonsai-2:4b ↗4.2B parameters · Q2_0 | 95.8 tok/s | 2,794 tok/s | Fits | 1.6 GB | 2.0 GB | Oct 20, 2026 |
| phi3:mini-4k ↗3.8B parameters · Q4_K_M | 95.7 tok/s | 3,322 tok/s | Fits | 2.4 GB | 3.2 GB | Oct 22, 2026 |
| qwen3-vl:4b ↗4.0B parameters · Q4_K_M | 93 tok/s | 3,289 tok/s | Fits | 3.3 GB | 4.0 GB | Oct 22, 2026 |
| qwen3.5:2b ↗1.9B parameters · Q8_0 | 93 tok/s | 6,609 tok/s | Fits | 2.7 GB | 2.9 GB | Oct 20, 2026 |
| gemma4:latest ↗7.5B parameters · Q4_K_M | 92 tok/s | 2,543 tok/s | Fits | 6.6 GB | 4.5 GB | Oct 20, 2026 |
| qwen3-vl:4b-instruct ↗4.0B parameters · Q4_K_M | 91.8 tok/s | 3,300 tok/s | Fits | 3.3 GB | 4.0 GB | Oct 22, 2026 |
| qwen3:4b-instruct ↗4.0B parameters · Q4_K_M | 90.5 tok/s | 3,277 tok/s | Fits | 2.5 GB | 2.8 GB | Oct 21, 2026 |
| qwen3:4b ↗4.0B parameters · Q4_K_M | 90 tok/s | 3,264 tok/s | Fits | 2.5 GB | 2.8 GB | Oct 21, 2026 |
| gemma3:latest ↗3.9B parameters · Q4_K_M | 87.2 tok/s | 3,381 tok/s | Fits | 3.4 GB | 3.6 GB | Oct 21, 2026 |
| medgemma:latest ↗4.3B parameters · Q4_K_M | 86.9 tok/s | 3,401 tok/s | Fits | 3.3 GB | 3.6 GB | Oct 20, 2026 |
| medgemma1.5:latest ↗4.3B parameters · Q4_K_M | 86.8 tok/s | 3,351 tok/s | Fits | 3.3 GB | 3.6 GB | Oct 20, 2026 |
| translategemma:latest ↗4.3B parameters · Q4_K_M | 86.6 tok/s | 3,369 tok/s | Fits | 3.3 GB | 3.5 GB | Oct 20, 2026 |
| granite4:1b ↗1.6B parameters · BF16 | 83.4 tok/s | 4,874 tok/s | Fits | 3.3 GB | 3.4 GB | Oct 22, 2026 |
| gemma3:4b-it-qat ↗3.9B parameters · Q4_0 | 76.7 tok/s | 3,668 tok/s | Fits | 4.0 GB | 4.2 GB | Oct 21, 2026 |
| deepseek-coder:6.7b-base ↗7B parameters · Q4_0 | 74.3 tok/s | 2,116 tok/s | Fits | 3.8 GB | 4.8 GB | Oct 22, 2026 |
| bonsai-2:latest ↗9.0B parameters · Q2_0 | 74.2 tok/s | 1,812 tok/s | Fits | 3.2 GB | 3.4 GB | Oct 20, 2026 |
| gemma4:e4b-it-qat ↗7.5B parameters · Q4_0 | 74 tok/s | 2,944 tok/s | Fits | 6.1 GB | 4.1 GB | Oct 20, 2026 |
| deepseek-coder:6.7b ↗7B parameters · Q4_0 | 73.6 tok/s | 2,242 tok/s | Fits | 3.8 GB | 4.8 GB | Oct 22, 2026 |
| codellama:code ↗7B parameters · Q4_0 | 73.5 tok/s | 2,112 tok/s | Fits | 3.8 GB | 4.8 GB | Oct 22, 2026 |
| llama2:text ↗7B parameters · Q4_0 | 73.3 tok/s | 2,104 tok/s | Fits | 3.8 GB | 4.8 GB | Oct 22, 2026 |
| codellama:latest ↗7B parameters · Q4_0 | 72.9 tok/s | 2,172 tok/s | Fits | 3.8 GB | 4.8 GB | Oct 22, 2026 |
| codellama:python ↗7B parameters · Q4_0 | 72.9 tok/s | 2,107 tok/s | Fits | 3.8 GB | 4.8 GB | Oct 22, 2026 |
| llama2:latest ↗7B parameters · Q4_0 | 72.6 tok/s | 2,164 tok/s | Fits | 3.8 GB | 4.8 GB | Oct 22, 2026 |
| mistral:v0.1 ↗7B parameters · Q4_0 | 71.9 tok/s | 2,296 tok/s | Fits | 4.1 GB | 4.3 GB | Oct 22, 2026 |
| mistral:text ↗7B parameters · Q4_0 | 71.6 tok/s | 2,295 tok/s | Fits | 4.1 GB | 4.3 GB | Oct 22, 2026 |
| mistral:v0.2 ↗7B parameters · Q4_0 | 71.5 tok/s | 2,292 tok/s | Fits | 4.1 GB | 4.3 GB | Oct 22, 2026 |
| llava:latest ↗7B parameters · Q4_0 | 71.4 tok/s | 2,265 tok/s | Fits | 4.7 GB | 4.9 GB | Oct 22, 2026 |
| mistral:instruct ↗7.2B parameters · Q4_0 | 71.3 tok/s | 2,284 tok/s | Fits | 4.1 GB | 4.3 GB | Oct 22, 2026 |
| qwen3.5:4b ↗4.2B parameters · Q4_K_M | 70.5 tok/s | 2,858 tok/s | Fits | 3.3 GB | 3.6 GB | Oct 20, 2026 |
| gemma3n:latest ↗6.9B parameters · Q4_K_M | 70.4 tok/s | 1,822 tok/s | Fits | 9.8 GB | 4.2 GB | Oct 22, 2026 |
| minicpm-v:latest ↗7.6B parameters · Q4_0 | 69.2 tok/s | 2,511 tok/s | Fits | 5.5 GB | 5.2 GB | Oct 22, 2026 |
| qwen2:7b-text ↗7.6B parameters · Q4_0 | 69.2 tok/s | 2,540 tok/s | Fits | 4.4 GB | 4.2 GB | Oct 22, 2026 |
| qwen2:latest ↗7.6B parameters · Q4_0 | 69.1 tok/s | 2,528 tok/s | Fits | 4.4 GB | 4.2 GB | Oct 22, 2026 |
| lfm2:latest ↗23.8B parameters · Q4_K_M | 67.4 tok/s | 1,398 tok/s | Doesn’t fit · 99% on GPU | 14.0 GB | 10.9 GB | Oct 20, 2026 |
| llama3:text ↗8.0B parameters · Q4_0 | 66.9 tok/s | 2,269 tok/s | Fits | 4.7 GB | 4.6 GB | Oct 22, 2026 |
| qwen:7b ↗8B parameters · Q4_0 | 66.9 tok/s | 2,119 tok/s | Fits | 4.5 GB | 5.2 GB | Oct 22, 2026 |
| mistral:latest ↗7.2B parameters · Q4_K_M | 66.6 tok/s | 2,066 tok/s | Fits | 4.4 GB | 4.5 GB | Oct 22, 2026 |
| qwen:7b-text ↗8B parameters · Q4_0 | 66.6 tok/s | 2,101 tok/s | Fits | 4.5 GB | 5.2 GB | Oct 22, 2026 |
| llama3:latest ↗8.0B parameters · Q4_0 | 65.4 tok/s | 2,264 tok/s | Fits | 4.7 GB | 4.6 GB | Oct 22, 2026 |
| nemotron-3.5-bolt:e4b ↗7.5B parameters · Q4_K_M | 64.7 tok/s | 2,200 tok/s | Fits | 7.2 GB | 6.2 GB | Oct 26, 2026 |
| qwen2.5vl:latest ↗8.3B parameters · Q4_K_M | 64.7 tok/s | 2,293 tok/s | Fits | 6.0 GB | 6.2 GB | Oct 22, 2026 |
| olmo2:latest ↗7.3B parameters · Q4_K_M | 64.5 tok/s | 2,005 tok/s | Fits | 4.5 GB | 5.3 GB | Oct 22, 2026 |
| qwen2.5-coder:7b-base ↗7.6B parameters · Q4_K_M | 64 tok/s | 2,284 tok/s | Fits | 4.7 GB | 4.5 GB | Oct 22, 2026 |
| falcon3:latest ↗7.5B parameters · Q4_K_M | 63.9 tok/s | 2,181 tok/s | Fits | 4.6 GB | 4.6 GB | Oct 22, 2026 |
| olmo-3:7b-instruct ↗7.3B parameters · Q4_K_M | 63.7 tok/s | 1,735 tok/s | Fits | 4.5 GB | 5.3 GB | Oct 21, 2026 |
| qwen2.5:latest ↗7.6B parameters · Q4_K_M | 63.7 tok/s | 2,295 tok/s | Fits | 4.7 GB | 4.5 GB | Oct 21, 2026 |
| olmo-3:latest ↗7.3B parameters · Q4_K_M | 63.6 tok/s | 1,742 tok/s | Fits | 4.5 GB | 5.3 GB | Oct 21, 2026 |
| deepseek-r1:7b ↗7.6B parameters · Q4_K_M | 63.5 tok/s | 2,274 tok/s | Fits | 4.7 GB | 4.5 GB | Oct 21, 2026 |
| qwen2.5-coder:latest ↗7.6B parameters · Q4_K_M | 63.4 tok/s | 2,292 tok/s | Fits | 4.7 GB | 4.5 GB | Oct 21, 2026 |
| cogito:latest ↗8.0B parameters · Q4_K_M | 61.9 tok/s | 2,063 tok/s | Fits | 4.9 GB | 4.8 GB | Oct 22, 2026 |
| dolphin3:latest ↗8.0B parameters · Q4_K_M | 61.7 tok/s | 2,090 tok/s | Fits | 4.9 GB | 4.8 GB | Oct 22, 2026 |
| llama3.1:latest ↗8.0B parameters · Q4_K_M | 61.4 tok/s | 2,066 tok/s | Fits | 4.9 GB | 4.8 GB | Oct 21, 2026 |
| qwen3-vl:8b-instruct ↗8.2B parameters · Q4_K_M | 59.9 tok/s | 1,974 tok/s | Fits | 6.2 GB | 6.4 GB | Oct 22, 2026 |
| qwen3-vl:latest ↗8.2B parameters · Q4_K_M | 59.9 tok/s | 1,963 tok/s | Fits | 6.2 GB | 6.4 GB | Oct 22, 2026 |
| minicpm-v4.5:latest ↗8.2B parameters · Q4_K_M | 59.1 tok/s | 1,968 tok/s | Fits | 6.1 GB | 6.0 GB | Oct 20, 2026 |
| lfm2.5:24b ↗24.0B parameters · Q4_K_M | 58 tok/s | 1,108 tok/s | Doesn’t fit · 99% on GPU | 15.0 GB | 10.9 GB | Oct 20, 2026 |
| deepseek-r1:latest ↗8.2B parameters · Q4_K_M | 57.7 tok/s | 1,983 tok/s | Fits | 5.2 GB | 5.1 GB | Oct 21, 2026 |
| qwen3:latest ↗8.2B parameters · Q4_K_M | 57.1 tok/s | 1,991 tok/s | Fits | 5.2 GB | 5.1 GB | Oct 21, 2026 |
| gemma:latest ↗9B parameters · Q4_0 | 56.8 tok/s | 1,917 tok/s | Fits | 5.0 GB | 5.9 GB | Oct 22, 2026 |
| gemma:text ↗9B parameters · Q4_0 | 55.1 tok/s | 1,868 tok/s | Fits | 5.2 GB | 6.1 GB | Oct 22, 2026 |
| granite4.1:8b ↗8.8B parameters · Q4_K_M | 54.8 tok/s | 1,727 tok/s | Fits | 5.3 GB | 5.3 GB | Oct 20, 2026 |
| granite4.2:latest ↗8.8B parameters · Q4_K_M | 54.8 tok/s | 1,716 tok/s | Fits | 5.3 GB | 5.3 GB | Oct 20, 2026 |
| ornith:latest ↗9.0B parameters · Q4_K_M | 54.2 tok/s | 1,820 tok/s | Fits | 5.6 GB | 5.1 GB | Oct 20, 2026 |
| ornith-1.5:9b ↗9.0B parameters · Q4_K_M | 54.1 tok/s | 1,789 tok/s | Fits | 6.6 GB | 6.2 GB | Oct 20, 2026 |
| ministral-3:latest ↗8.9B parameters · Q4_K_M | 53.5 tok/s | 2,567 tok/s | Fits | 6.0 GB | 5.9 GB | Oct 21, 2026 |
| gemma4:12b ↗11.9B parameters · Q4_K_M | 53.1 tok/s | 1,014 tok/s | Fits | 7.7 GB | 8.3 GB | Oct 20, 2026 |
| gemma2:latest ↗9.2B parameters · Q4_0 | 50.1 tok/s | 1,705 tok/s | Fits | 5.4 GB | 6.0 GB | Oct 21, 2026 |
| qwen3.5:latest ↗9.0B parameters · Q4_K_M | 47.9 tok/s | 1,794 tok/s | Fits | 6.6 GB | 6.2 GB | Oct 20, 2026 |
| falcon3:10b ↗10.3B parameters · Q4_K_M | 46.5 tok/s | 1,518 tok/s | Fits | 6.3 GB | 6.3 GB | Oct 22, 2026 |
| laguna-xs-2.1:latest ↗33.4B parameters · Q4_K_M | 45.4 tok/s | 518 tok/s | Doesn’t fit · 98% on GPU | 20.0 GB | 10.8 GB | Oct 20, 2026 |
| mistral-nemo:latest ↗12.2B parameters · Q4_0 | 44.2 tok/s | 1,509 tok/s | Fits | 7.1 GB | 6.8 GB | Oct 22, 2026 |
| ornith:35b ↗34.7B parameters · Q4_K_M | 41.5 tok/s | 452 tok/s | Doesn’t fit · 98% on GPU | 21.0 GB | 10.7 GB | Oct 20, 2026 |
| codellama:13b-code ↗13B parameters · Q4_0 | 41 tok/s | 1,181 tok/s | Fits | 7.4 GB | 8.7 GB | Oct 22, 2026 |
| llama2:13b-text ↗13B parameters · Q4_0 | 41 tok/s | 1,189 tok/s | Fits | 7.4 GB | 8.7 GB | Oct 22, 2026 |
| llava:13b ↗13B parameters · Q4_0 | 40.5 tok/s | 1,199 tok/s | Fits | 8.0 GB | 9.3 GB | Oct 22, 2026 |
| codellama:13b ↗13B parameters · Q4_0 | 40.4 tok/s | 1,203 tok/s | Fits | 7.4 GB | 8.7 GB | Oct 22, 2026 |
| codellama:13b-python ↗13B parameters · Q4_0 | 40.4 tok/s | 1,181 tok/s | Fits | 7.4 GB | 8.7 GB | Oct 22, 2026 |
| llama2:13b ↗13B parameters · Q4_0 | 40.3 tok/s | 1,207 tok/s | Fits | 7.4 GB | 8.7 GB | Oct 22, 2026 |
| gemma4:12b-it-qat ↗11.9B parameters · Q4_0 | 39.4 tok/s | 1,259 tok/s | Fits | 7.2 GB | 7.4 GB | Oct 20, 2026 |
| gpt-oss:latest ↗20.9B parameters · MXFP4 | 39.4 tok/s | 1,535 tok/s | Doesn’t fit · 90% on GPU | 14.0 GB | 10.1 GB | Oct 21, 2026 |
| flint:latest ↗39.8B parameters · NVFP4 | 39.2 tok/s | 437 tok/s | Doesn’t fit · 91% on GPU | 23.0 GB | 10.1 GB | Oct 26, 2026 |
| phi3:medium ↗14.0B parameters · Q4_0 | 39.2 tok/s | 1,245 tok/s | Fits | 7.9 GB | 8.0 GB | Oct 22, 2026 |
| phi3:medium-4k ↗14.0B parameters · Q4_0 | 39.2 tok/s | 1,248 tok/s | Fits | 7.9 GB | 8.0 GB | Oct 22, 2026 |
| gemma3:12b ↗11.8B parameters · Q4_K_M | 38 tok/s | 1,175 tok/s | Fits | 8.2 GB | 8.4 GB | Oct 21, 2026 |
| translategemma:12b ↗12.2B parameters · Q4_K_M | 37.9 tok/s | 1,178 tok/s | Fits | 8.1 GB | 8.3 GB | Oct 20, 2026 |
| qwen:14b ↗14B parameters · Q4_0 | 37.8 tok/s | 1,170 tok/s | Fits | 8.2 GB | 9.1 GB | Oct 22, 2026 |
| qwen:14b-text ↗14B parameters · Q4_0 | 37.7 tok/s | 1,168 tok/s | Fits | 8.2 GB | 9.1 GB | Oct 22, 2026 |
| qwen3.5:35b ↗34.7B parameters · Q4_K_M | 37.3 tok/s | 431 tok/s | Doesn’t fit · 98% on GPU | 22.0 GB | 11.5 GB | Oct 20, 2026 |
| olmo2:13b ↗13.7B parameters · Q4_K_M | 36 tok/s | 1,103 tok/s | Fits | 8.4 GB | 9.4 GB | Oct 22, 2026 |
| gemma3:12b-it-qat ↗11.8B parameters · Q4_0 | 35.6 tok/s | 1,281 tok/s | Fits | 8.9 GB | 9.1 GB | Oct 21, 2026 |
| gemma4:26b-a4b-it-qat ↗25.2B parameters · Q4_0 · gemma-4-26B-A4B-it-qat-q4_0 profile | 35.2 tok/s | 598 tok/s | Doesn’t fit · 96% on GPU | 16.0 GB | 9.6 GB | Oct 20, 2026 |
| ministral-3:14b ↗13.9B parameters · Q4_K_M | 35 tok/s | 1,656 tok/s | Fits | 9.1 GB | 8.8 GB | Oct 21, 2026 |
| phi4:latest ↗14.7B parameters · Q4_K_M | 34.7 tok/s | 1,119 tok/s | Fits | 9.1 GB | 8.9 GB | Oct 22, 2026 |
| cogito:14b ↗14.8B parameters · Q4_K_M | 33.8 tok/s | 1,065 tok/s | Fits | 9.0 GB | 8.6 GB | Oct 22, 2026 |
| north-mini-code-1.0:latest ↗30.5B parameters · Q4_K_M | 33.8 tok/s | 547 tok/s | Doesn’t fit · 99% on GPU | 19.0 GB | 10.9 GB | Oct 20, 2026 |
| qwen3:14b ↗14.8B parameters · Q4_K_M | 33.6 tok/s | 1,105 tok/s | Fits | 9.3 GB | 8.9 GB | Oct 21, 2026 |
| qwen2.5-coder:14b ↗14.8B parameters · Q4_K_M | 33.5 tok/s | 1,080 tok/s | Fits | 9.0 GB | 8.6 GB | Oct 21, 2026 |
| deepseek-r1:14b ↗14.8B parameters · Q4_K_M | 33.4 tok/s | 1,062 tok/s | Fits | 9.0 GB | 8.6 GB | Oct 21, 2026 |
| qwen2.5-coder:14b-base ↗14.8B parameters · Q4_K_M | 33.4 tok/s | 1,072 tok/s | Fits | 9.0 GB | 8.6 GB | Oct 22, 2026 |
| qwen2.5:14b ↗14.8B parameters · Q4_K_M | 33.3 tok/s | 1,081 tok/s | Fits | 9.0 GB | 8.6 GB | Oct 21, 2026 |
| qwen3:30b ↗30.5B parameters · Q4_K_M | 33.1 tok/s | 731 tok/s | Doesn’t fit · 98% on GPU | 19.0 GB | 10.1 GB | Oct 21, 2026 |
| qwen3:30b-instruct ↗30.5B parameters · Q4_K_M | 33.1 tok/s | 737 tok/s | Doesn’t fit · 98% on GPU | 19.0 GB | 10.1 GB | Oct 21, 2026 |
| qwen3-vl:30b ↗31.1B parameters · Q4_K_M | 32.9 tok/s | 566 tok/s | Doesn’t fit · 98% on GPU | 20.0 GB | 11.4 GB | Oct 22, 2026 |
| qwen3-vl:30b-a3b-instruct ↗30.5B parameters · Q4_K_M | 32.7 tok/s | 555 tok/s | Doesn’t fit · 98% on GPU | 20.0 GB | 11.5 GB | Oct 22, 2026 |
| bonsai-2:27b ↗26.9B parameters · Q2_0 | 32.5 tok/s | 583 tok/s | Fits | 8.3 GB | 8.2 GB | Oct 20, 2026 |
| qwen3-coder:latest ↗30.5B parameters · Q4_K_M | 31.5 tok/s | 720 tok/s | Doesn’t fit · 98% on GPU | 19.0 GB | 10.1 GB | Oct 21, 2026 |
| glm-4.7-flash:latest ↗29.9B parameters · Q4_K_M | 31 tok/s | 473 tok/s | Doesn’t fit · 98% on GPU | 19.0 GB | 10.8 GB | Oct 20, 2026 |
| laguna-xs.2:latest ↗33.4B parameters · Q4_K_M | 30.5 tok/s | 437 tok/s | Doesn’t fit · 96% on GPU | 23.0 GB | 10.8 GB | Oct 20, 2026 |
| gemma4:26b ↗25.2B parameters · Q4_K_M | 29.6 tok/s | 503 tok/s | Doesn’t fit · 68% on GPU | 16.0 GB | 10.2 GB | Oct 20, 2026 |
| nemotron-cascade-2:latest ↗31.6B parameters · Q4_K_M | 28.1 tok/s | 443 tok/s | Doesn’t fit · 98% on GPU | 18.0 GB | 10.7 GB | Oct 20, 2026 |
| nemotron-3-nano:latest ↗31.6B parameters · Q4_K_M | 27 tok/s | 437 tok/s | Doesn’t fit · 98% on GPU | 18.0 GB | 10.5 GB | Oct 21, 2026 |
| nemotron3:latest ↗33.0B parameters · Q4_K_M | 25.5 tok/s | 363 tok/s | Doesn’t fit · 97% on GPU | 21.0 GB | 9.3 GB | Oct 20, 2026 |
| qwen3.6:35b-a3b-coding ↗35.5B parameters · Q4_K_M | 18.6 tok/s | 410 tok/s | Doesn’t fit · 96% on GPU | 23.0 GB | 9.8 GB | Oct 20, 2026 |
| nemotron-3.5-lightning:latest ↗32.9B parameters · Q4_K_M | 18.2 tok/s | 418 tok/s | Doesn’t fit · 96% on GPU | 19.0 GB | 10.6 GB | Oct 20, 2026 |
| qwen3.6:latest ↗35.5B parameters · Q4_K_M | 17.3 tok/s | 423 tok/s | Doesn’t fit · 98% on GPU | 23.0 GB | 11.2 GB | Oct 30, 2026 |
| phi4-reasoning:latest ↗14.7B parameters · Q4_K_M | 14.9 tok/s | 1,172 tok/s | Doesn’t fit · 90% on GPU | 11.0 GB | 10.1 GB | Oct 22, 2026 |
| phi4-reasoning:plus ↗14.7B parameters · Q4_K_M | 14.9 tok/s | 1,155 tok/s | Doesn’t fit · 90% on GPU | 11.0 GB | 10.1 GB | Oct 22, 2026 |
| granite4:32b-a9b-h ↗32.2B parameters · Q4_K_M | 14 tok/s | 364 tok/s | Doesn’t fit · 98% on GPU | 19.0 GB | 10.0 GB | Oct 22, 2026 |
| mistral-small:22b ↗22.2B parameters · Q4_0 | 7.5 tok/s | 505 tok/s | Doesn’t fit · 91% on GPU | 13.0 GB | 10.1 GB | Oct 22, 2026 |
| mistral-small:latest ↗23.6B parameters · Q4_K_M | 5.4 tok/s | 471 tok/s | Doesn’t fit · 72% on GPU | 14.0 GB | 10.2 GB | Oct 22, 2026 |
| mistral-small3.2:latest ↗24.0B parameters · Q4_K_M | 5.3 tok/s | 575 tok/s | Doesn’t fit · 95% on GPU | 15.0 GB | 11.0 GB | Oct 22, 2026 |
| qwen3.6:27b ↗27.3B parameters · Q4_K_M | 5.1 tok/s | 239 tok/s | Doesn’t fit · 60% on GPU | 18.0 GB | 11.4 GB | Oct 20, 2026 |
| qwen3.6:27b-coding ↗27.3B parameters · Q4_K_M | 5.1 tok/s | 238 tok/s | Doesn’t fit · 60% on GPU | 18.0 GB | 11.4 GB | Oct 20, 2026 |
| qwen3.8:latest ↗27.3B parameters · Q4_K_M | 4.1 tok/s | 222 tok/s | Doesn’t fit · 59% on GPU | 18.0 GB | 11.2 GB | Oct 20, 2026 |
| qwen3.5:27b ↗26.9B parameters · Q4_K_M | 3.9 tok/s | 300 tok/s | Doesn’t fit · 66% on GPU | 17.0 GB | 11.5 GB | Oct 20, 2026 |
| gemma4:31b ↗30.7B parameters · Q4_K_M | 3.8 tok/s | 183 tok/s | Fits | 19.0 GB | 10.1 GB | Oct 20, 2026 |
| gemma2:27b ↗27.2B parameters · Q4_0 | 3.7 tok/s | 295 tok/s | Doesn’t fit · 64% on GPU | 16.0 GB | 10.1 GB | Oct 21, 2026 |
| translategemma:27b ↗27.4B parameters · Q4_K_M | 3.7 tok/s | 278 tok/s | Doesn’t fit · 89% on GPU | 17.0 GB | 11.6 GB | Oct 20, 2026 |
| muse-glimmer:latest ↗27.9B parameters · Q4_K_M | 3.4 tok/s | 286 tok/s | Doesn’t fit · 57% on GPU | 18.0 GB | 9.4 GB | Oct 20, 2026 |
| gemma3:27b ↗27.0B parameters · Q4_K_M | 3.3 tok/s | 262 tok/s | Doesn’t fit · 61% on GPU | 17.0 GB | 10.9 GB | Oct 21, 2026 |
| medgemma:27b ↗27.4B parameters · Q4_K_M | 3.3 tok/s | 260 tok/s | Doesn’t fit · 89% on GPU | 17.0 GB | 10.9 GB | Oct 21, 2026 |
| granite4.1:30b ↗28.9B parameters · Q4_K_M | 3.2 tok/s | 274 tok/s | Doesn’t fit · 62% on GPU | 17.0 GB | 10.8 GB | Oct 20, 2026 |
| granite4.2:30b ↗29.3B parameters · Q4_K_M | 3.2 tok/s | 281 tok/s | Doesn’t fit · 61% on GPU | 18.0 GB | 10.8 GB | Oct 20, 2026 |
| gemma3:27b-it-qat ↗27.0B parameters · Q4_0 | 3.1 tok/s | 264 tok/s | Doesn’t fit · 60% on GPU | 18.0 GB | 11.1 GB | Oct 21, 2026 |
| qwen:32b ↗33B parameters · Q4_0 | 2.8 tok/s | 254 tok/s | Doesn’t fit · 55% on GPU | 18.0 GB | 10.2 GB | Oct 22, 2026 |
| qwen:32b-text ↗33B parameters · Q4_0 | 2.8 tok/s | 262 tok/s | Doesn’t fit · 55% on GPU | 18.0 GB | 10.2 GB | Oct 22, 2026 |
| codellama:34b-python ↗34B parameters · Q4_0 | 2.6 tok/s | 240 tok/s | Doesn’t fit · 53% on GPU | 19.0 GB | 9.9 GB | Oct 22, 2026 |
| gemma4:31b-it-qat ↗30.7B parameters · Q4_0 | 2.6 tok/s | 216 tok/s | Doesn’t fit · 95% on GPU | 19.0 GB | 9.5 GB | Oct 20, 2026 |
| codellama:34b ↗34B parameters · Q4_0 | 2.5 tok/s | 245 tok/s | Doesn’t fit · 53% on GPU | 19.0 GB | 9.9 GB | Oct 22, 2026 |
| deepseek-coder:33b ↗33B parameters · Q4_0 | 2.5 tok/s | 255 tok/s | Doesn’t fit · 54% on GPU | 19.0 GB | 10.0 GB | Oct 22, 2026 |
| olmo-3:32b ↗32.2B parameters · Q4_K_M | 2.5 tok/s | 203 tok/s | Doesn’t fit · 95% on GPU | 19.0 GB | 10.1 GB | Oct 21, 2026 |
| olmo-3.1:32b-instruct ↗32.2B parameters · Q4_K_M | 2.5 tok/s | 209 tok/s | Doesn’t fit · 95% on GPU | 19.0 GB | 10.1 GB | Oct 21, 2026 |
| olmo-3.1:latest ↗32.2B parameters · Q4_K_M | 2.5 tok/s | 208 tok/s | Doesn’t fit · 95% on GPU | 19.0 GB | 10.1 GB | Oct 21, 2026 |
| cogito:32b ↗32.8B parameters · Q4_K_M | 2.4 tok/s | 228 tok/s | Doesn’t fit · 51% on GPU | 20.0 GB | 10.0 GB | Oct 22, 2026 |
| llava:34b ↗34B parameters · Q4_0 | 2.4 tok/s | 244 tok/s | Doesn’t fit · 52% on GPU | 20.0 GB | 10.8 GB | Oct 22, 2026 |
| qwen2.5-coder:32b ↗32.8B parameters · Q4_K_M | 2.4 tok/s | 226 tok/s | Doesn’t fit · 51% on GPU | 20.0 GB | 10.0 GB | Oct 21, 2026 |
| qwen2.5-coder:32b-base ↗32.8B parameters · Q4_K_M | 2.4 tok/s | 222 tok/s | Doesn’t fit · 51% on GPU | 20.0 GB | 10.0 GB | Oct 22, 2026 |
| qwen2.5:32b ↗32.8B parameters · Q4_K_M | 2.4 tok/s | 227 tok/s | Doesn’t fit · 51% on GPU | 20.0 GB | 10.0 GB | Oct 21, 2026 |
| qwen2.5vl:32b ↗33.5B parameters · Q4_K_M | 2.4 tok/s | 226 tok/s | Doesn’t fit · 93% on GPU | 21.0 GB | 11.2 GB | Oct 22, 2026 |
| qwen3-vl:32b ↗33.4B parameters · Q4_K_M | 2.4 tok/s | 225 tok/s | Doesn’t fit · 93% on GPU | 21.0 GB | 11.5 GB | Oct 22, 2026 |
| qwen3-vl:32b-instruct ↗33.4B parameters · Q4_K_M | 2.4 tok/s | 226 tok/s | Doesn’t fit · 93% on GPU | 21.0 GB | 11.5 GB | Oct 22, 2026 |
| deepseek-r1:32b ↗32.8B parameters · Q4_K_M | 2.3 tok/s | 224 tok/s | Doesn’t fit · 51% on GPU | 20.0 GB | 10.0 GB | Oct 21, 2026 |
| qwen3:32b ↗32.8B parameters · Q4_K_M | 2.3 tok/s | 222 tok/s | Doesn’t fit · 51% on GPU | 20.0 GB | 10.1 GB | Oct 21, 2026 |
20 models couldn’t run on this machine
- phonon:40m-ptNeeds a newer Ollama · 0.1 GB download · Oct 25, 2026
- phonon:40m-multilingualNeeds a newer Ollama · 0.1 GB download · Oct 25, 2026
- phonon:40m-frNeeds a newer Ollama · 0.1 GB download · Oct 25, 2026
- phonon:40m-esNeeds a newer Ollama · 0.1 GB download · Oct 25, 2026
- phonon:40m-enNeeds a newer Ollama · 0.1 GB download · Oct 25, 2026
- phonon:40m-deNeeds a newer Ollama · 0.1 GB download · Oct 25, 2026
- phonon:enNeeds a newer Ollama · 0.1 GB download · Oct 25, 2026
- phonon:latestNeeds a newer Ollama · 0.1 GB download · Oct 25, 2026
- phonon:ptNeeds a newer Ollama · 0.1 GB download · Oct 23, 2026
- phonon:multilingualNeeds a newer Ollama · 0.1 GB download · Oct 23, 2026
- phonon:frNeeds a newer Ollama · 0.1 GB download · Oct 23, 2026
- phonon:esNeeds a newer Ollama · 0.1 GB download · Oct 23, 2026
- phonon:deNeeds a newer Ollama · 0.1 GB download · Oct 23, 2026
- deepseek-coder:33b-baseFailed to load or run · 19.0 GB download · Oct 22, 2026
- granite3.1-moe:1bFailed to load or run · 1.4 GB download · Oct 22, 2026
- codellama:34b-codeFailed to load or run · 19.0 GB download · Oct 22, 2026
- llama3.2-vision:latestNeeds a newer Ollama · 7.8 GB download · Oct 22, 2026
- rnj-1:latestFailed to load or run · 5.1 GB download · Oct 22, 2026
- devstral-small-2:latestFailed to load or run · 15.0 GB download · Oct 21, 2026
- ornith-1.5:35bFailed to load or run · 23.0 GB download · Oct 20, 2026
Failed tests are tried again after 14 days, sooner when Ollama is updated.
How these speeds are measured
Each model is loaded once to warm up, then asked to write 512 tokens 3 times. Writing speed is the median of those runs. Reading speed comes from one prompt of about 1,500 tokens. All runs use temperature 0, a 4,096-token context, reasoning (“thinking”) turned off where the model supports it, and Ollama’s default settings and download for each tag, with nothing else using the graphics card. Every morning the lab tests new models first, then re-times its oldest results so they keep up with Ollama and driver updates.
“Fits in 12 GB” means Ollama kept the whole model in the graphics card’s memory. “Doesn’t fit” shows the share that did; the rest ran from system memory, which is much slower and depends on this machine’s processor and RAM.
What these numbers don’t tell you
Speed is not quality: a fast model can give worse answers. Results change with the runtime version, driver, context length, longer conversations and running several requests at once. Downloads larger than 23 GB and models that can’t write text are not tested.
Download and memory figures use decimal GB. See models that should fit a 12GB budget · Read the memory guide · Compare ratings