llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 4× NVIDIA RTX 3090 · llama.cpp

NVIDIA hardware
Aug 28, 2026
Throughput
55.0 t/s gen
Quant
Q4 (GGUF)
VRAM reported
24 GB

Summary

User reports 55 t/s on 4x3090 with a Q4 GGUF.