llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Gufo · 65,536 ctx

Tone: positiveAMD hardware
Oct 26, 2026
Throughput
42-46 t/s gen · 966-1186 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q4_K_XL (GGUF)
System RAM
128 GB

Use cases

codingagenticmath

Summary

User compares Qwen3.8-Flash-Next and its Swift 1.5 fine-tune across Halogen, gufo and llama.cpp on a Strix Halo 128GB machine, all with MTP. The gufo run with Unsloth's UD-Q4_K_XL decodes at 42-46 t/s with 966-1,186 t/s prefill at a 32k prompt and 64k context. Setup is gufo with the 111.3 GB UD-Q4_K_XL GGUF and Unsloth's shared Q8_0 MTP head; TTFT was 20-27 s and server start 25 s. Halogen's own .hgn build decodes faster at 51-60 t/s, and llama.cpp trails at 20-23 t/s decode and 298-320 t/s prefill. The user suggests gufo with the Swift requant for coding, which finished the 11 Pi tasks in 24 min against 33 min for Unsloth's file on gufo.