llamaperf
Oct 14, 2026
Throughput
90.0 t/s gen
Quant
IQ3_S (GGUF)
System RAM
64 GB
VRAM reported
32 GB

Use cases

coding

Summary

User reports Qwen3.8-Flash-Next IQ3_S at approximately 90 tk/s decode on an AMD R9700 32GB with 64GB RAM. Setup is Strata with IQ3_S quant. The user notes this is about 3x faster than a 27B model and was surprised by the quality given the small Q3 quant.