llamaperf

Qwen3.6 27B

on NVIDIA DGX Spark · llama.cpp

Tone: positiveNVIDIA hardware
Oct 8, 2026
Throughput
7-11 t/s gen
KV cache
turbo4
System RAM
128 GB

Use cases

coding

Summary

User reports Qwen3.6 27B at 7-11 tok/s with stock llama.cpp on an NVIDIA DGX Spark (GB10), consistent across every scenario tested. Setup is stock llama.cpp on one GB10 with no speculative decoding and a q8_0 KV cache, the whole model in unified memory; the post does not state the target quant for the stock run. With DFlash speculative decoding (spiritbuun fork, Q4_K_M target, Q8_0 draft, turbo4 KV) the author gives per-task ranges only: 38-40 tok/s HTML/JS, 24-25 Python, 23-25 short chat, 20-22 medium context and 27-29 sustained over 2048 tokens. Q8_0 and BF16 targets are slower. vLLM with MTP reached around 30 tok/s. The 35B-A3B MoE runs 60-66 tok/s stock and up to 113 tok/s on HTML/JS with DFlash.