Qwen3.8 27B
on NVIDIA RTX 5090 · NInfer
Summary
User compares NVFP4 against Q5_K_M on Qwen3.8-27B.
NVFP4 with adjusted sampling (temp=0.9, min_p=0.05) reaches 80% strict on IFBench, matching local BF16 and near official BF16 79.5%, while Q5_K_M stays at 76%.
NVFP4 runs about 3x faster and uses less VRAM. The Q5_K_M run uses llama.cpp.