llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× NVIDIA RTX 3090 · Strata · 90,000 ctx

Tone: mixedNVIDIA hardware
Oct 24, 2026
Throughput
3536.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Summary

User reports a GPU unlock module raising prefill on Qwen3.8 Flash-Next under Strata on 2 RTX 3090s, from 3205 to 3536 tok/s at 90K context, a 10% gain. The module, gpu-unlock by Zagitta, sets FMLA32 to full before the NVIDIA driver loads; the user measured 4K and 10K prefill gains of 12% each. BF16 tensor math rose from 82 to 155 TFLOPS and TF32 from 41 to 79 TFLOPS, but outputs were unchanged byte for byte over 1996 teacher-forced positions. The user asks whether it works on 40-series cards.