llamaperf

Qwen3.8 125B (6B active) Flash-Next Abliterated

on Unknown GPU · Strata

Tone: positive
Oct 11, 2026
Throughput
20-30 t/s gen
Quant
IQ3_S (GGUF)
System RAM
32 GB
VRAM reported
12 GB

Summary

User reports Qwen3.8-Flash-Next-GSQ-RCO-Abliterated at IQ3_S running with 12GB VRAM and 32GB system RAM, achieving 20-30 tok/sec decode and 300 to ~90 thousand tok/sec prefill on a custom fork of Strata. The Q2 quant achieves 39-45 tok/s decode. The fork has many experimental architectural changes. User compares the experience to local Opus on sub 2k compute.