Qwen3-Next 80B (3B active)

User benchmarks Qwen3-Next-80B-A3B-Instruct Q4_K_M on an RTX 4070 Ti Super 16GB, reporting 67.54 t/s median decode on real text and 80.673 t/s on a repeated prompt. Setup is llama.cpp b11617 with -ncmoe 48, --moe-cache-mib 10752, 4096 context and a single-CCD CPU affinity mask; the 46.64GB model streams experts from system memory over PCIe. All figures are warm-cache, 435 prompt tokens and 256 generated tokens. A 512 MiB expert cache was 23.8% slower than no cache, and decode fell 70.5% at -ncmoe 44. Random token IDs decoded at 93.61 t/s, about 38% faster than real text.