llamaperf

Qwen3.8 27B

on Unknown GPU · 65,536 ctx

Tone: mixed
Sep 27, 2026
Throughput
30.0 t/s gen
Quant
IQ4_XS (GGUF)
KV cache
Q8
VRAM reported
16 GB

Use cases

codingagentic

Summary

User reports Qwen3.8 27B at about 30 t/s on a 16GB VRAM machine. Setup is the Unsloth IQ4_XS quant with Q8 KV cache at 65k context, no MTP, vision offloaded to CPU. User calls the speed acceptable but slow for agentic work and asks which 16GB quant gives the best speed, context and quality, questioning whether Q3 quants are safe for general knowledge.