Qwen3.6 27B
on NVIDIA DGX Spark · vllm.cpp
Summary
User reports a C++20 port of the vLLM serving stack on a DGX Spark with Qwen3.6-27B NVFP4, reaching 86.05 to 1095.01 output tokens/sec across concurrency 1 to 32.
The port runs slightly ahead of vLLM in the same tests.
The user also reports DeepSeek-V4-Flash in 2-bit GGUF at 18.69 tok/s on the Spark, and compares against llama.cpp and MLX-LM.