Qwen3.8 27B

User reports Qwen3.8-27B NVFP4 on an RTX 5090 decoding at 267-282 tok/s on a mixed short-prompt set with the DFlash2 block drafter, against 192 tok/s for the recipe's MTP-10 and 77 tok/s with speculation off. Setup is NInfer with NVFP4 weights and speculative decoding; the same campaign also measured llama.cpp, Ollama and vLLM, and a 5080 16 GB desktop for comparison. The 450 tok/s NVFP4 recipe figure reproduced at 426-457 tok/s on a recall workload that copies from the prompt, while ordinary prose decodes at 113-141 tok/s; 8 concurrent requests totalled 673 tok/s with MTP-3.