llamaperf

Qwen3.8 27B

on NVIDIA RTX 4080 · NInfer · 8,192 ctx

Tone: positiveNVIDIA hardware
Oct 9, 2026
Throughput
166.7 t/s gen · 2719.9 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
GSQ (safetensors)
KV cache
rk4v4-e8
VRAM reported
16 GB

Use cases

coding

Summary

User reports Qwen3.8 27B at 166.7 t/s generation and 2719.9 t/s prefill on an RTX 4080 16GB. Setup is NInfer with GSQ safetensors and rk4v4-e8 KV cache, single card, DFlash2 speculative decoding at 8K context. User also reports MTP3 decode at 151.2 t/s and DFlash2 K=7 decode at 262.3 t/s at 32K, with prefill up to 2720 t/s and 100k context support.