llamaperf

Qwen3.8 27B

on NVIDIA RTX 3090 · llama.cpp · 131,072 ctx

Tone: mixedNVIDIA hardware
Oct 1, 2026
Throughput
36.4 t/s gen
Quant
Q4_K_M (GGUF)
KV cache
q8_0
System RAM
64 GB
VRAM reported
24 GB

Use cases

codingagentic

Summary

User reports Qwen3.8-27B at 36.4 tok/s on an RTX 3090 24GB, with throughput dropping to 20.9 tok/s at 120K context. Setup is llama.cpp with Q4_K_M and q8_0 KV cache, all layers on GPU, 131,072-token context, flash attention, one generation slot. The 36.4 tok/s figure is for a 2,073-token input with thinking disabled; cached continuations reuse almost the entire prefix and are not representative of fresh prompts. Peak GPU memory was 22,162 MiB. Three of four bounded coding tasks passed their checks, with one failing after spending its full 8,192-token output allowance on reasoning.