llamaperf

Qwen3.8 125B (6B active) Flash-Next Abliterated

on Unknown GPU · Strata · 131,072 ctx

Tone: positive
Oct 17, 2026
Throughput
40-50 t/s gen · 1300-1500 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ3_S (GGUF)
System RAM
32 GB
VRAM reported
12 GB

Summary

User reports running Qwen3.8-Flash-Next-GSQ-RCO-Abliterated at IQ3_S with 12GB VRAM, 32GB RAM and NVMe, achieving 40-50 tok/sec decode and 1300-1500 tok/sec prefill at 131k context with a 44k thinking budget. Setup uses a custom fork of Strata with experimental architectural changes, offloading to system RAM and SSD. The user describes the performance as feeling like local Opus in some regards.