llamaperf

Qwen3.8 125B (6B active) Flash-Next

on Unknown GPU · Strata · 100,000 ctx

Tone: mixed
Oct 14, 2026
Throughput
20.0 t/s gen
Quant
GSQ-RCO-IQ1_M (GGUF)
System RAM
32 GB
VRAM reported
8 GB

Use cases

coding

Summary

User reports Qwen3.8-Flash-Next at 20 t/s on 8GB VRAM plus 32GB DDR4 RAM with Strata at 100k context. Setup uses the GSQ-RCO-IQ1_M GGUF quant with a 5GB MTP model, on a custom HIP build for gfx1030 that the Strata dev does not support. The user says the speed is close to llama.cpp with 35B models, but the model never stopped analyzing a Plymouth boot theme script and burned through 100k context plus a compaction and another 100k context without finishing.