Qwen3.6 35B (3B active)
NVIDIA RTX 4070 Super · ik_llama.cpp · 131,072 ctx
- generation:
- 110.2 tokens/s
- quant:
- IQ4_XS-4.19bpw (GGUF)
- kv:
- Q8
- mtp (multi-token prediction):
- on
User benchmarks llama.cpp at 89.76 t/s against ik_llama.cpp at 110.24 t/s on Qwen3.6-35B-A3B with MTP. Setup is the IQ4_XS quant on a Ryzen 7 9700X running CachyOS, with the GPU used as a secondary card and the iGPU for display. The ik_llama.cpp run is a 23% speed increase.