Qwen3.8 27B
on NVIDIA RTX 5070 Ti Laptop 12GB · llama.cpp · 98,304 ctx
Use cases
codingagenticlong-context
Summary
User reports Qwen 3.8 27B at ~9-11 t/s decode and 400-550 t/s prefill on an RTX 5070 Ti Laptop 12GB.
Setup is llama.cpp with UD_Q4_K_XL quant, q8_0 KV cache, 98304 context, draft-mtp speculative decoding, and FFN weights offloaded to CPU.
The user notes reasoning verbosity blows past 100K tokens in planning, and with Magic Context the session scaled past 3.7M total processed tokens.