- generation:
- 25.0 tokens/s
- prompt processing (prefill):
- 700.0 tokens/s
- quant:
- TQ2_0 (GGUF)
User reports Qwen3.8-Flash-Next at 25 t/s decode and 700 t/s prefill on an RX 6800 XT 16GB. Setup is Strata with a TQ2_0 quant on a Ryzen 7 5800X3D with 32GB DDR4. User asks for a second opinion on the configuration, noting most benchmarks they have seen are Nvidia with very different settings.