Qwen3.8 27B Swift-1.5-Uncensored-Dynamic
on Strix Halo 64GB · llama.cpp · 102,400 ctx
Summary
User reports Qwen3.8-27B at 22.65 t/s generation and 63.57 t/s prefill on a Strix Halo 395 with 64GB.
Setup is llama.cpp (Vulkan build) with a Q5_K_M GGUF and f16 KV cache, 102400 context, MTP speculative decoding with draft acceptance 0.68425.
User asks for advice on the best Windows-based setup to reach 20+ tok/s on this model.