llamaperf

Qwen3.6 35B (3B active)

on NVIDIA DGX Spark · llama.cpp

NVIDIA hardware
Oct 28, 2026
Throughput
3556.7 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)

Summary

User benchmarks a llama.cpp CUDA PR that fuses MoE gate/up matmuls and GLU in MMQ, reporting prompt-processing throughput on DGX Spark (GB10) and RTX 5090. On DGX Spark with Qwen3.6-35B-A3B Q4_K_M, prompt processing rises from 3235.8 to 3556.7 t/s (+9.9%); the Qwen3-30B-A3B Q4_K_M row goes from 2911.4 to 3410.8 t/s (+17.2%). On RTX 5090 the same Qwen3.6-35B-A3B Q4_K_M row goes from 15000.3 to 15852.0 t/s (+5.7%), with UD-Q4_K_M at 15030.2 to 15947.8 t/s (+6.1%). No generation speeds are given.