llamaperf
Sep 29, 2026
Throughput
150.0 t/s gen
Quant
MXFP4-FP8 (MXFP4)

Use cases

codingagentic

Summary

User reports Qwen3.8 Flash-Next at 150+ t/s single-stream generation on 4x Radeon AI PRO R9700 32GB. Setup uses the MXFP4-FP8 quant from tcclaviger, tested with agentic coding use-cases in a pi harness. User also gets 3-5 concurrent streams at ~100 t/s generation each, and prefill of 10k+ t/s. Speed and quality both exceeded expectations.