Qwen3.8 Distill

User reports Qwen3.8-Distill at 165.9 t/s decode on an RTX 4090 24GB. Setup is llama.cpp with llama-swap, q8_0 KV cache, flash attention on, 256K context, and speculative draft-MTP enabled. The post is a registry of many models on the same card; the highest measured decode listed is 363 t/s for Nemotron-Lightning-3.5, and context cliffs are noted for several models.