Qwen3.8 27B

User reports 136.7 t/s generation. Source evidence (verbatim): Source: https://kgptalkie.com/tutorials/llm-benchmarking/qwen-3-8-27b-llama-cpp-speed-settings # Qwen 3.8 27B Speed Settings on llama.cpp Hardware: NVIDIA RTX 5090 32GB. Engine: llama.cpp b10448. Model: Qwen 3.8 27B Q4_K_M. Baseline with MTP off (no speculative decoding, flash attention on, f16 KV cache, 17966 MB VRAM): decode 73.6 tok/s, prompt 3036 tok/s (the article does not explicitly tie the prompt figure to this run). Best MTP run (speculative decoding on: --spec-type draft-mtp, --spec-draft-n-max 2, q4_0 K and V cache, flash attention on, context 32768, -np 1, -ngl 999): decode 136.7 tok/s, 17412 MB VRAM. Best draft-depth-only run n=3 with f16 cache: 133.6 tok/s, reverse-order rerun 129.7 tok/s. MTP reduces prompt processing by roughly 5 to 8 percent.