llamaperf
Oct 8, 2026
Throughput
12.0 t/s gen
System RAM
80 GB

Use cases

codingtool-use

Summary

User reports Qwen3.8 Flash-Next at 12 t/s on an RTX 4070 Super with 80GB DDR4. Setup is Unsloth desktop, but the model errors out on anything beyond simple questions and refuses coding tasks with a message format error. The user also tried Qwen 27B in Q2 at 3 t/s, Qwen 3.6 35B at 20 t/s, and Ornith, which thinks for 30 minutes before erroring. They mention using LM Studio, Ollama, Open WebUI, and llama.cpp in the browser, and note that Qwen 27B with Q4 KV cache at 8K context gives 6 t/s.