Qwen3.8 27B
on NVIDIA RTX 4070 Ti Super · llama.cpp · 262,144 ctx
Sep 7, 2026
Use cases
long-context
Summary
User reports a full 256k context offloaded to VRAM with no CPU spillover, using n-gram speculative decoding.
Generation speed degrades with context depth: 43.69 t/s at 32k, 36.59 t/s at 64k, 27.55 t/s at 128k, 22.15 t/s at 192k, and 18.48 t/s at 256k.
Prompt processing also degrades similarly.