Qwen3.6 27B
on NVIDIA DGX Spark · llama.cpp
Oct 8, 2026
Use cases
coding
Summary
User reports Qwen3.6 27B at 7-11 tok/s with stock llama.cpp on an NVIDIA DGX Spark (GB10), consistent across every scenario tested.
Setup is stock llama.cpp on one GB10 with no speculative decoding and a q8_0 KV cache, the whole model in unified memory; the post does not state the target quant for the stock run.
With DFlash speculative decoding (spiritbuun fork, Q4_K_M target, Q8_0 draft, turbo4 KV) the author gives per-task ranges only: 38-40 tok/s HTML/JS, 24-25 Python, 23-25 short chat, 20-22 medium context and 27-29 sustained over 2048 tokens. Q8_0 and BF16 targets are slower. vLLM with MTP reached around 30 tok/s. The 35B-A3B MoE runs 60-66 tok/s stock and up to 113 tok/s on HTML/JS with DFlash.