llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD Strix Halo 128GB · Halogen · 262,144 ctx

Tone: positiveAMD hardware
Oct 11, 2026
Throughput
60-70 t/s gen · 1155.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
System RAM
128 GB

Use cases

agenticlong-contextvision

Summary

User reports Qwen3.8-Flash-Next running on a BOSGAME M5 with AMD Ryzen AI Max+ 395 / Radeon 8060S (Strix Halo) and 128 GB unified RAM, showing ~69 tok/s peak decode and ~1,155 tok/s prefill with peaks around 1,685 tok/s during a real long-running agent workload. Setup is Halogen 0.17.2 on Ubuntu 26.04 with 262K context configured and vision enabled; decode stays in the 60–70 tok/s range while prefill remains above 1k tok/s for much of the workload. The figures come from a Grafana dashboard tracking Halogen throughput, KV/context usage, RAM, PSI memory pressure and GPU metrics; context was ~84% full, 82K tokens generated in the last hour, GPU around 62°C and 24 W, with ~121 GB physically occupied but mostly reclaimable cache (~85 GB).