llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 6× NVIDIA RTX 3090 · ExLlamaV3

Tone: positiveNVIDIA hardware
Sep 26, 2026
Throughput
80-120 t/s gen
Quant
6bpw (EXL3)

Use cases

agenticcoding

Summary

User reports Qwen3.8 Flash-Next at 80-120 t/s on 6x RTX 3090. Setup is ExLlamaV3 with a 6bpw EXL3 quant from turboderp. The user describes the throughput as a range and praises the engine for CUDA, using it with the Hermes agent controlled from a phone via Matrix.