llamaperf

Qwen3.8 125B (6B active) Flash-Next

on AMD RX 7900 XTX · llama.cpp · 262,144 ctx

Tone: positiveAMD hardware
Sep 7, 2026
Throughput
14.4 t/s gen · 448.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q4_K_XL (GGUF)
KV cache
Q8
System RAM
96 GB
VRAM reported
24 GB

Use cases

long-contextvision

Summary

User reports a custom llama.cpp Vulkan backend patch for Qwen3.8-Flash-Next improves prompt processing from 346 to 448 t/s and generation from 13.3 to 14.4 t/s at 2.7k context. At 131k context, prompt processing improves from 195 to 263 t/s and generation from 9.1 to 10.4 t/s. The patch fixes a top-k fallback to CPU in sparse attention. Greedy outputs are identical, the needle is found at 131k, and images are read correctly.