llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Rulith Inference

Tone: positiveAMD hardware
Oct 3, 2026
Throughput
46.0 t/s gen
Quant
UD-IQ4_XS (GGUF)
System RAM
128 GB

Use cases

codingagentic

Summary

User reports Qwen3.8-Flash-Next (125B-A6B, Unsloth UD-IQ4_XS) at 46 tok/s short and 42 tok/s at 86K context with MTP on a single conversation, on a Ryzen AI Max+ 395 (Strix Halo 128GB) under Windows. Setup is Rulith Inference 0.4 (formerly Strix Llama) with MTP speculative decoding and 2-token drafts. Prefill is 1,237 tok/s over a 95.6K-token prompt. With MTP off, 8 conversations of ~40K tokens each reach 91 tok/s combined; short prompts with typical sampling reach ~100 tok/s. The user runs it as a local worker for coding agents, seeing 30+ tok/s with one agent, 50+ combined with two, and 60+ with three. A caveat is that the local model guesses more (IDs, file paths, field names), so output goes through review.