llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× NVIDIA RTX 3060 12GB · llama.cpp

Tone: mixedNVIDIA hardware
Oct 12, 2026
Throughput
15.0 t/s gen
Quant
IQ3_XXS (GGUF)
System RAM
64 GB

Use cases

coding

Summary

User reports Qwen3.8-Flash-Next at 15 t/s on 2x RTX 3060 12GB with 64GB RAM, compared to Strata's 35 t/s on thinking and 50 t/s on code. Setup is vanilla llama.cpp with IQ3_XXS and no MTP drafter, as the only available MTP Q4_K_M drafter is 3.5x larger and slows decode. User asks for a working llama recipe, noting tensor split fails with a cudaMalloc error on device 0.