llamaperf

Qwen3.8 125B (6B active) Flash-Next

on Unknown GPU · Strata · 130,000 ctx

Tone: positive
Oct 14, 2026
Throughput
57.4 t/s gen
Quant
UD-Q4_K_XL (GGUF)
KV cache
FP16

Summary

User reports Qwen3.8-Flash-Next at 57.4 t/s generation on Strata, versus 18.84 t/s with llama.cpp (Unsloth fork) on the same Hermes session. Setup is Strata with UD-Q4_K_XL GGUF weights, FP16 KV cache and 130k context; llama.cpp ran the same files at 110k context. Strata read a 38,968-token prompt in 23 seconds where llama.cpp took about 10 minutes, and the user reports roughly 3x the generation speed. The user notes expert cache hit was 94.5% with 1.3% of routed experts over PCIe, and that earlier builds gave only about 45 t/s.