llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD MI50 16GB · llama.cpp · 131,072 ctx

Tone: positiveAMD hardware
Sep 18, 2026
Throughput
16.9 t/s gen
Quant
IQ4 (GGUF)
KV cache
Q8
System RAM
64 GB
VRAM reported
16 GB

Summary

User reports Qwen3.8 Flash-Next at 16.9 t/s on a single MI50 16GB with the gfx906-16gb-expert-pool llama.cpp fork. Setup uses the moe-expert-pool branch with IQ4 GGUF weights, 128K context and Q8 KV cache; the expert cache profile of 66 admits 144 pools at roughly 69% hit rate and peaks at 15.24 GiB VRAM. A stock CPU MoE path without the expert cache reached 11.76 t/s, and up to 19.8 t/s was observed once warm.