llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD RX 6900 XT 16GB · Strata · 65,536 ctx

Tone: positiveAMD hardware
Oct 17, 2026
Throughput
41.5 t/s gen
Quant
Q2_0 (GGUF)
KV cache
Q8
System RAM
32 GB
VRAM reported
16 GB

Use cases

coding

Summary

User reports Qwen3.8 Flash-Next at 41.5 t/s on an RX 6900 XT 16GB, generating a roughly 4500-token animated SVG response; a Python task ran at about 32 tok/s. Setup is Strata with Q2_0 weights, 64k context and Q8 KV cache, using around 13.2GB VRAM on a Ryzen 7 5700X with 32GB DDR4 3600. The user has not filled the 64k context yet and wonders whether Q4 KV would allow more; the plan is 64GB RAM with IQ3_S, and IQ3_XXS is also being considered.