llamaperf

Qwen3.8 27B

on NVIDIA RTX Pro 6000 Blackwell · llama.cpp · 262,144 ctx

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
153.9 t/s gen
Quant
Q4_K_M (GGUF)
KV cache
F16
VRAM reported
96 GB

Summary

User benchmarks DFlash 2 speculative decoding on Qwen 3.8 27B with a llama.cpp PR build on an RTX PRO 6000 Blackwell 96GB and a Ryzen 9 9950X. Setup is llama.cpp with 262144 context, an f16 KV cache and full offload. The user reports 2.26x speedup on LiveCodeBench, from 67.97 to 153.91 tok/s, and 4.68x on multi-turn coding with n-gram lookup, and gives a detailed analysis of n-gram drafters and draft width.