Oct 4, 2026
Summary
User reports Qwen3.8-Flash-Next at 21 t/s on llama.cpp with IQ3_XXS, running on system RAM plus a Radeon AI PRO R9700 32GB.
Setup is llama.cpp with IQ3_XXS, model partially offloaded to system RAM (64GB DDR5).
User also reports ~60 t/s with the same quant on Strata, and 35 t/s for Qwen3.8-27B Q6 on the R9700. System RAM usage reaches 96% with Flash-Next loaded, preventing simultaneous ComfyUI workloads.