llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 4× NVIDIA DGX Spark · SGLang · 262,144 ctx

NVIDIA hardware
Sep 7, 2026
Throughput
51.1 t/s gen
Quant
NVFP4

Summary

User reports 51.06 t/s single-stream and 184.03 t/s aggregate at c6 on 2x DGX Spark in TP2. Setup is SGLang with QSA, NEXTN and FlashInfer GDN. Disabling NEXTN gives 26.4 t/s at c1 and 111.8 t/s at c6. Medium thinking scored 22/24 on a 24-task LiveBench-style pilot.