llamaperf

Qwen3.6 35B (3B active) Claude-4.6-Opus-Reasoning-Distilled

on GTX 1660 Super · ik_llama.cpp · 131,072 ctx

Tone: negative
Oct 8, 2026
Throughput
10.4 t/s gen · 118.8 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ4_XS (GGUF)
VRAM reported
6 GB

Summary

User reports ik_llama.cpp at 118.79 t/s prompt processing and 10.40 t/s generation on a GTX 1660 Super 6GB with Qwen3.6-35B-A3B IQ4_XS at 131072 context. Setup is ik_llama.cpp with --cpu-moe, -ngl 999, -amb 2048, -rtr and --prompt-cache-all on an AMD Ryzen 7 5800X. Mainline llama.cpp on the same machine reached 239.81 t/s PP and 15.69 t/s TG, so ik_llama.cpp is about 2x slower on PP and 1.5x slower on TG. User suspects --prompt-cache-all, -rtr or -amb 2048 may be responsible.