What people run, by hardware
Pick the kind of machine you have. You'll see the model sizes people report running on it, most reported first, with the speed they typically get. It tells you what works on hardware like yours. It doesn't tell you which model gives the best answers.
To check a specific model on your exact card, use the calculator. For coding, see the coding models by VRAM.
AMD and Intel up to 16 GB
Discrete AMD and Intel cards up to 16 GB, on ROCm, Vulkan or SYCL. Memory speed 224 to 1,024 GB/s across the 18 devices with reports, so a typical figure here spans all of them. 72 single-device reports.
| # | Model | Reports | Gen t/s | PP t/s | With speculation |
|---|---|---|---|---|---|
| 1 | Qwen3.827B Alibaba · mostly IQ3_XXS Gen 18 t/s (7 runs) · PP 371 t/s (2 runs) · with speculation 46 t/s (4) | 20 | 18 7 runs, 6 devices | 371 2 runs | 46 4 runs |
| 2 | Qwen3.8 Flash-Next125B · 6B active Alibaba · mostly IQ2_XS No generation data | 11 | no generation data | no PP data | none |
| 3 | Qwen3.635B · 3B active Alibaba · mostly IQ2_XXS No generation data · with speculation 110 t/s (1) | 9 | no generation data | no PP data | 110 1 run |
| 4 | Qwen38B Alibaba · mostly Q4_K_M Gen 80 t/s (2 runs) · PP 2548 t/s (2 runs) · with speculation 133 t/s (1) | 3 | 80 2 runs, 2 devices | 2548 2 runs | 133 1 run |
| 5 | Bonsai 227B PrismML · mostly ternary Gen 45 t/s (3 runs) · PP 1188 t/s (2 runs) | 3 | 45 3 runs | 1188 2 runs | none |
| 6 | Qwen3.59B Alibaba · mostly Q6_K_XL Gen 35 t/s (2 runs) | 3 | 35 2 runs | no PP data | none |
| 7 | Qwen3.8 Swift-1.527B Alibaba · mostly IQ3_S Gen 30 t/s (1 run) · with speculation 44 t/s (1) | 3 | 30 1 run | no PP data | 44 1 run |
| 8 | Gemma 412B Google DeepMind · mostly IQ4_NL Gen 35 t/s (1 run) · PP 654 t/s (1 run) · with speculation 20 t/s (1) | 2 | 35 1 run | 654 1 run | 20 1 run |
| 9 | Bonsai27B PrismML · mostly Q1_0 Gen 73 t/s (1 run) | 1 | 73 1 run | no PP data | none |
| 10 | Qwen2.5 Coder14B Alibaba · mostly Q4_K_M Gen 34 t/s (1 run) · PP 1210 t/s (1 run) | 1 | 34 1 run | 1210 1 run | none |
| 11 | Qwen31.7B Alibaba · mostly Q8_0 Gen 33 t/s (1 run) | 1 | 33 1 run | no PP data | none |
| 12 | GLM-49B mostly Q4_0 Gen 21 t/s (1 run) | 1 | 21 1 run | no PP data | none |
| 13 | Qwen3.6 Coder27B · 3B active Alibaba · mostly Q4_K_M Gen 14 t/s (1 run) | 1 | 14 1 run | no PP data | none |
| 14 | Qwen34B Alibaba · mostly Q4_K_M Gen 13 t/s (1 run) · PP 261 t/s (1 run) | 1 | 13 1 run | 261 1 run | none |
| 15 | Llama 3.18B Meta · mostly Q4_K_M Gen 1.5 t/s (1 run) | 1 | 1.5 1 run | no PP data | none |
| 16 | Bonsai 2 Ternary27B PrismML · mostly 2-bit ternary No generation data | 1 | no generation data | no PP data | none |
| 17 | GLM-5.2744B · 40B active Zhipu AI · mostly fmt=4 grouped int4, gs=64 No generation data | 1 | no generation data | no PP data | none |
| 18 | Llama 27B mostly Q4_0 No generation data · PP 4454 t/s (1 run) | 1 | no generation data | 4454 1 run | none |
| 19 | Muse Glimmer30B Meta · mostly UD-Q2-K-XL No generation data · with speculation 20 t/s (1) | 1 | no generation data | no PP data | 20 1 run |
| 20 | Ornith1.59B mostly Q6_K No generation data | 1 | no generation data | no PP data | none |
| 21 | Qwen3.5 DeepSeek-V4-Flash9B Alibaba · mostly Q6_K No generation data · with speculation 49 t/s (1) | 1 | no generation data | no PP data | 49 1 run |
| 22 | Qwen3.627B Alibaba · mostly Q4_K_M No generation data | 1 | no generation data | no PP data | none |
| 23 | Qwen3.6 Omnimerge-v427B Alibaba · mostly IQ3_M No generation data · with speculation 46 t/s (1) | 1 | no generation data | no PP data | 46 1 run |
| 24 | Qwen3.6 Tiel-Coder35B · 3B active Alibaba · mostly Q4_K_XL No generation data | 1 | no generation data | no PP data | none |
| 25 | Qwen3.8 Huihui-Abliterated27B Alibaba · mostly IQ3_XXS No generation data | 1 | no generation data | no PP data | none |
| 26 | Qwen3.8 ASCII-Condensed27B Alibaba · mostly UD-IQ4_XS No generation data | 1 | no generation data | no PP data | none |
Not in the table: 4 reports don't say which model size ran. 14 ran on more than one device, which says nothing about what one of them does.
How this list works
Each row is one model size, because a 27B and a 397B from the same family are different choices. Rows are ordered by how many people report running that size on this hardware.
Generation speed is the median of runs on one device, serving one request, without speculative decoding. PP is the median prompt-processing speed from plain runs that reported it, so its run count can be smaller. Speculative decoding (MTP, a draft model, DFlash, n-gram lookup) can make the same model several times faster, so those runs get their own column. A report that doesn't make clear which kind of run it was counts in neither.
Hardware is grouped by how much it holds and how fast its memory is, since memory speed sets how fast a model writes. Click a model for every report behind its row.