Qwen3.8 27B Uncensored
on 2× NVIDIA V100 32GB · llama.cpp · 262,144 ctx
Oct 3, 2026
Summary
User reports Qwen3.8-27B-Uncensored at 833.37 prompt tok/s and 43.34 decode tok/s on two NVIDIA Tesla V100 GPUs.
Setup is llama.cpp with Q8_0 weights, F16 KV cache, 262,144-token context, tensor split 1,1, and the built-in MTP head with draft length 3.
The matching DFlash2 Q8 candidate measured 607.82 prompt tok/s and 33.00 decode tok/s, so MTP remains the production default. A single-V100 Q4_K_M profile with Q4_0 KV and MTP draft length 1 reached 44.201 tok/s on a 512-token short test and 13.001 tok/s on a 255,000-token capacity run.