llamaperf

Qwen3.8 27B

on Unknown GPU · llama.cpp · 96,000 ctx

Tone: mixed
Oct 3, 2026
Throughput
40-60 t/s gen
Quant
IQ3_S (GGUF)
VRAM reported
16 GB

Use cases

agentic

Summary

User asks whether to keep MTP draft enabled for agentic work with Qwen3.8-27B IQ3_S on 16GB of VRAM, served through llama.cpp for a local Hermes agent. With MTP enabled the user reports prefill is slower, the model seems less smart, and VRAM is tight enough to force a 96k context; decode runs around 40 to 60 t/s. With MTP disabled the context can go to 128k but decode drops to about 35 t/s.