Qwen3.8 27B
on NVIDIA RTX 5070 Ti · llama.cpp · 196,608 ctx
Sep 9, 2026
Use cases
coding
Summary
User reports Qwen3.8 27B at Q4 running at 50 t/s on 16 GB VRAM with 200K context.
Setup uses adaptive-kv streaming to fit 196,608 tokens, with Q8_0 K and Q4_0 V cache quantization. The user pruned non-ASCII characters from the embedding table and LM head to save 700 MB, offloaded the embedding table to save 270 MB, and disabled MTP.