llamaperf

Qwen3.8

on 2× AMD RX 7900 XTX · llama.cpp

Tone: positiveAMD hardware
Sep 8, 2026
Throughput
24.0 t/s gen · 920.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q3_K_XL
VRAM reported
24 GB

Use cases

coding

Summary

User reports Qwen3.8 Next Q3_K_XL at 24/27 tk/s on prose and 40+ tk/s on code with MTP on two 7900 XTX cards, with prefill at 920 tk/s pp8192. Setup is a custom llama.cpp build optimized for the 7900 XTX, with RAM offload and without the MoE expert cache. The user also benchmarks Qwen3.8 27B Q8_0 with tensor parallel at 1600 tk/s pp8192, 60/65 tk/s prose and 100+ tk/s code, and Qwen3.6 27B Q4_K_M on a single card with MTP at 1020 tk/s pp8192, about 58/60 tk/s prose and 75/80 tk/s code.