llamaperf

Qwen3.8 125B (6B active) Flash-Next

on Strix Halo 64GB · llama.cpp · 130,000 ctx

Tone: positive
Oct 8, 2026
Throughput
25-30 t/s gen · 200-300 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ3-XXS (GGUF)
KV cache
Q4_0
System RAM
64 GB

Use cases

codingagentic

Summary

User reports Qwen3.8 Flash-Next at 25-30 t/s at 130k context on a GPD Win 5 with 64GB Strix Halo, docked. Setup is a llama.cpp fork with IQ3-XXS quant and Q4_0 KV cache, using MTP speculative decoding with a 64k vocab limit and Q5 hyper-connections. On battery the same model runs at 18-24 t/s with 70-80 minutes per battery pack. Qwen3.8 27B runs at 12-19 t/s at 8k context, and Tiel 35B-A3B-Q6_K_XL averages around 50 t/s at 64k context. A desktop GMKtec EVO-X2 with the same engine and model gives 30-35 t/s at that depth.