llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · llama.cpp · 160,000 ctx

Tone: positiveAMD hardware
Sep 30, 2026
Throughput
7.1 t/s gen · 113.5 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
System RAM
128 GB
VRAM reported
128 GB

Summary

User compares Qwen3.8 Flash-Next Q4_K_M at 160,000 context across a Strix Halo and a six-GPU machine. On Strix Halo with mainline llama.cpp 0.4.1 the run reaches 113.48 t/s prefill and 7.06 t/s generation. Setup is llama.cpp with Q4_K_M weights, 103.68 GiB model, fully in the Strix Halo's 128GB unified memory. At the same context the Gufo fork gives 1227.12 t/s prefill and 22.04 t/s generation, Halo Box gives 587.99 t/s and 21.24 t/s, and the pile of GPUs (2x RTX 5070 Ti, 2x RTX 5060 Ti 16GB, 2x RX 7900 XTX) gives 215.73 t/s and 16.29 t/s. User concludes Strix Halo shines for this model.