Qwen3.8 27B
on Unknown GPU · llama.cpp · 96,000 ctx
Use cases
agentic
Summary
User asks whether to keep MTP draft enabled for agentic work with Qwen3.8-27B IQ3_S on 16GB of VRAM, served through llama.cpp for a local Hermes agent.
With MTP enabled the user reports prefill is slower, the model seems less smart, and VRAM is tight enough to force a 96k context; decode runs around 40 to 60 t/s. With MTP disabled the context can go to 128k but decode drops to about 35 t/s.