llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Gufo · 262,144 ctx

AMD hardware
Oct 14, 2026
Throughput
33.5 t/s gen
Quant
UD-Q4_K_XL (GGUF)
System RAM
128 GB

Use cases

codingagentic

Summary

User reports 33.5 t/s generation. Source evidence (verbatim): Source: https://llmkube.com/docs/labs/qwen38-flash-next-gufo-on-strix-halo # First-hand Gufo Qwen3.8 Flash Next UD-Q4_K_XL single-stream generation on Strix Halo 128GB Christopher Maher's first-hand lab report, live deployment dated October 2, 2026. Measured AMD Ryzen AI Max+ 395 / Radeon 8060S gfx1151, Strix Halo 128GB. Installed unified memory: 128GB LPDDR5X. Selected single-stream agent-style run: generation 33.5 tokens/s, using MTP. Approximately 4K tokens of Go source plus coding instruction; up to 512 completion tokens; reasoning included, thinking defaults on. Server has two session slots, but this measured row has one stream, not two concurrent requests. Decode is completion tokens divided by generation time. Selected run prompt-processing speed unreported; leave promptTps null. Separate cold-prefill and two-stream rows must not be combined with this selected generation run. Qwen3.8-Flash-Next UD-Q4_K_XL, GGUF. Tested repository verified: https://huggingface.co/unsloth/Qwen3.8-Flash-Next-GGUF ; source reports short revision 38bb39ee, independently opened revision tree returned a generic tool error; full SHA not verified. Four quantization shards, 103.69 GiB on disk. Shared Q8_0 MTP head path: MTP/mtp-Qwen3.8-Flash-Next-shared-Q8_0.gguf in that repository; 2.60 GiB disk size. Disk sizes are not resident RAM. Gufo HIP engine, context capacity 262144. Exact commit/version for selected bake-off row unestablished; later deployed Gufo v0.5.0/23cacbb9379d5a8e8531535270891729ca6c00dd is separate and must not be assigned to this earlier measurement. Core counts, power, selected resident memory, exact prompt count, CPU offload, KV quantization and sampling settings unreported. Lab author builds LLMKube. Client uses workstation kubectl port-forward to an otherwise idle node, one candidate at a time. Sources: https://llmkube.com/docs/labs/qwen38-flash-next-gufo-on-strix-halo ; https://llmkube.com/blog/qwen38-flash-next-gufo-strix-halo .