llamaperf
Oct 3, 2026
Throughput
50-90 t/s gen
Quant
IQ1_M (GGUF)
System RAM
48 GB
VRAM reported
32 GB

Use cases

coding

Summary

User compares two local Qwen models against Claude Opus 4.6 on three Python coding tasks, scoring hidden tests and code review. The local Qwen3.8-Flash-Next Coder model tied Opus 4.6 at 92.7 out of 100, while Qwen 3.8 27B Q6 scored 87.0. Setup is two RTX 5060 Ti 16GB cards (32 GB VRAM total) on an Intel Core i5-14400 with 48 GB DDR4 RAM, Windows 11. The Coder model is a pruned Strata variant keeping half the experts per layer, as an IQ1_M GGUF, running between 50 and 90 tokens/s, around 60-65 on average. The 27B Q6 Unsloth quant runs at a steady 50 tokens/s. User notes one run per model, differences of 2-3 points are meaningless, and the Coder model was graded harder with more weird-input cases. The review was done by Claude Fable 5.1 with public grading sheets.