llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× AMD Radeon AI PRO R9700 32GB · Strata · 105,884 ctx

Tone: positiveAMD hardware
Nov 5, 2026
Throughput
86.8 t/s gen · 1207.0 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
Quant
IQ3_S (GGUF)
System RAM
128 GB
VRAM reported
32 GB

Use cases

long-contextagentic

Summary

User reports Qwen3.8 Flash-Next at 86.8 output t/s and 1,207 input t/s prefill on two Radeon AI PRO R9700 32GB cards, at 105,884 input tokens. Setup is Strata engine 0.1.56 on Windows with IQ3_S weights and a 196,608-token context setting, on a Ryzen 7 7800X3D with 128 GB DDR5. A real Hermes research run averaged 95 output t/s across 14 responses with input context up to 85,334 tokens. Synthetic long-context tests gave 123 t/s at 98,304 input tokens and 148.7 t/s at 192,512, which the user says do not establish sustained real workload speed.