Qwen3.8 27B Swift-1.5
on NVIDIA RTX 5070 Ti · llama.cpp · 60,000 ctx
Summary
User reports Qwen3.8-27B (Swift-1.5 fine-tune, IQ3_S GGUF) at 106.96 t/s generation and 1831.68 t/s prompt processing on an RTX 5070 Ti 16GB.
Setup is llama.cpp with Q8_0 KV cache, 60000 context, flash attention on, and MTP plus n-gram speculative decoding (draft-mtp,ngram-map-k4v, draft-n-max 3).
User is happy with the speed but wants a larger context window and asks for advice on the launch arguments.