llamaperf

Qwen3.8 2400B (95B active)

on 5× NVIDIA RTX 5090 · llama.cpp · 65,536 ctx

Tone: negativeNVIDIA hardware
Sep 7, 2026
Throughput
0.3 t/s gen
Quant
UD-Q1_0
System RAM
96 GB
VRAM reported
32 GB

Summary

User reports Qwen3.8 2.4T at 0.25 t/s on dual RTX 5090s and three RTX 3090s with 96 GB of system RAM. The model is 397 GB, far exceeding available VRAM and RAM, at 64k context. The user deems the speed unusable.