llamaperf
Sep 15, 2026
Quant
GPU-5 (GGUF)

Use cases

mathcodingtool-usemultilingualagentic

Summary

User reports ShapeLearn GGUFs for Qwen 3.8 27B, with the 3.84 bpw (GPU-5) quant reaching 99.63% of BF16's aggregate score across 8 benchmarks and the 3.23 bpw (GPU-4) quant reaching 98.72%. Benchmarks were run on RTX Pro 6000 Blackwell, RTX 5090, RTX 4090, RTX 3090, RTX 4080 and RTX 5060 Ti. DFlash2 delivered 1.34-2.10x baseline throughput and MTP delivered 1.28-1.66x with temperature sampling. User notes that Unsloth Dynamic V3's UD-IQ3_S had ~20% lower KLD than a similarly sized Lite model but scored 95.55% versus Lite's 97.33% of BF16's aggregate benchmark score.