llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 4080 · llama.cpp · 98,304 ctx

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
8.0 t/s gen
Quant
Q4_K_M (GGUF)
System RAM
64 GB
VRAM reported
16 GB

Summary

User reports running a 182B model on an RTX 4080 with 64GB RAM by offloading ngrams to SSD. User claims it is faster and more intelligent than Qwen3.8 27B and provides the launch command.