llamaperf

Qwen3-Coder Next / b8180 self-build, PP512 TG128 at prepared depth32768

on HP Zbook Ultra G1a / Radeon 8060S (Strix Halo; 128 GB unified RAM; CPU SKU unknown) · llama.cpp

Oct 13, 2026
Throughput
24.2 t/s gen · 344.0 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
Quant
Q8_0 (GGUF)
KV cache
F16
Flash Attention
on
MTP (Multi-Token Prediction)
off
System RAM
128 GB

Summary

User reports Qwen3-Coder-Next Q8_0 at 24.2 t/s generation and 344 t/s prompt processing on an HP Zbook Ultra G1a Strix Halo laptop with 128 GB unified RAM and a Radeon 8060S gfx1151 GPU. Setup is a self-compiled llama.cpp b8180 with ROCm 7.2, flash attention, ngl 99, and no speculative decoding, run at 32768 depth. The figures are separate synthetic PP512 and TG128 tests, not one sampled request; the same run measured 343.99 t/s PP and 24.21 t/s TG at depth 32768, and 251.15 t/s PP and 22.09 t/s TG at depth 65536.

Compare this run

Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.

Every Qwen3-Coder report →