llamaperf

Qwen3.8 27B

on NVIDIA RTX 4090 · llama.cpp · 92,160 ctx

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
134.0 t/s gen
Quant
Q4_K_XL (GGUF)
KV cache
Q8
System RAM
128 GB
VRAM reported
24 GB

Summary

User reports Qwen3.8-27B on an RTX 4090, with throughput ranging from 44 t/s to 134 t/s and no RAM spilling. Setup includes an mmproj file for vision.