llamaperf

Qwen3.6 35B (3B active)

on NVIDIA RTX 4070 Super · ik_llama.cpp · 131,072 ctx

Tone: positiveNVIDIA hardware
May 21, 2026
Throughput
110.2 t/s gen
Quant
IQ4_XS-4.19bpw (GGUF)
KV cache
Q8
MTP (Multi-Token Prediction)
on
System RAM
48 GB
VRAM reported
12 GB

Use cases

codingsummarizationmath

Summary

User benchmarks llama.cpp at 89.76 t/s against ik_llama.cpp at 110.24 t/s on Qwen3.6-35B-A3B with MTP. Setup is the IQ4_XS quant on a Ryzen 7 9700X running CachyOS, with the GPU used as a secondary card and the iGPU for display. The ik_llama.cpp run is a 23% speed increase.