llamaperf

Qwen3.8 27B

on NVIDIA RTX 5090 · NInfer

Tone: positiveNVIDIA hardware
Sep 7, 2026
Quant
NVFP4
VRAM reported
32 GB

Summary

User compares NVFP4 against Q5_K_M on Qwen3.8-27B. NVFP4 with adjusted sampling (temp=0.9, min_p=0.05) reaches 80% strict on IFBench, matching local BF16 and near official BF16 79.5%, while Q5_K_M stays at 76%. NVFP4 runs about 3x faster and uses less VRAM. The Q5_K_M run uses llama.cpp.