Qwen3.8 27B
on NVIDIA RTX Pro 4000 Blackwell SFF · llama.cpp · 262,144 ctx
Sep 7, 2026
Use cases
codingtool-usemultilingual
Summary
User reports a custom iMatrix quant with mixed precision: NVFP4 for bulk matrices, Q5_K/Q6_K for attention, DeltaNet and FFN, Q6_K embeddings, Q8_0 output head and NVFP4 MTP.
WikiText-2 PPL is 6.1197 versus 6.1127 for Q4_1.
MTP target-only decode runs at 21.189 t/s, with MTP at 59.456 t/s. At full 261.5K context decode is 12.606 t/s. The GGUF is published on HF.