llamaperf

Qwen3.8

on NVIDIA RTX 3090

NVIDIA hardware
Sep 7, 2026
Throughput
10.1 t/s gen
Quant
IQ4_XS (GGUF)
System RAM
96 GB
VRAM reported
24 GB

Summary

User reports Qwen 3.8 Next at ~10.1 t/s on an RTX 3090 capped at 250W, with a Xeon e5 2690v4 and 96GB DDR4 RAM. Setup replaces the N-gram layer with Q8 precision on top of an IQ4_XS quant. The user reports no meaningful speed penalty from the change.