llamaperf
Oct 4, 2026
Throughput
21.0 t/s gen
Quant
IQ3_XXS (GGUF)
System RAM
64 GB

Summary

User reports Qwen3.8-Flash-Next at 21 t/s on llama.cpp with IQ3_XXS, running on system RAM plus a Radeon AI PRO R9700 32GB. Setup is llama.cpp with IQ3_XXS, model partially offloaded to system RAM (64GB DDR5). User also reports ~60 t/s with the same quant on Strata, and 35 t/s for Qwen3.8-27B Q6 on the R9700. System RAM usage reaches 96% with Flash-Next loaded, preventing simultaneous ComfyUI workloads.