Qwen3.8 27B (6B active)

User benchmarks Qwen3.8-Flash-Next with DFlash2 speculative decoding on an RTX 5090, reporting 118.63 tok/s single-stream decode. Setup is TensorRT-LLM with NVFP4 weights, a 90-token prompt and 512 forced output tokens, five trials per batch size. Aggregate decode throughput rises to 1,284.55 tok/s at batch 12 with the selector policy, while per-client throughput falls to 92.27 tok/s at batch 15. A V2 dual-cache deadlock was fixed before the batch-15 trials completed.