llamaperf
Oct 2, 2026
Throughput
40.0 t/s gen
Quant
IQ3_S (GGUF)
System RAM
64 GB
VRAM reported
16 GB

Use cases

codingagentic

Summary

User reports Qwen3.8-Flash-Next at ~40 tk/s on an RTX 4080 Super 16GB. Setup is the strata engine with an IQ3_S quant, run through a custom mini swe agent v2 with powershell, edit_file, view_image, read_file and search_files tools, plus guards for tool failures and auto-compaction. The one-prompt GTA-style three.js game took 3h 18m 6s and 22,845,556 tokens (22,533,061 input, 312,495 output). The user notes the IQ3 quant fucks up a lot.