llamaperf

Qwen3.8 Heretic2

on AMD Strix Halo 128GB · llama.cpp · 65,536 ctx

Tone: positiveAMD hardware
Sep 21, 2026
Throughput
24.0 t/s gen
Quant
IQ4_XS (GGUF)
System RAM
128 GB

Use cases

coding

Summary

User benchmarks 12 quantizations of Qwen3.8-Flash-Next on an AMD Strix Halo 128GB, reporting 24 t/s decode and 312-382 t/s prefill at 512-2K tokens with llama-server. Setup is llama.cpp (llama-flash-next fork) with the Heretic2 IQ4_XS NGQ4 GGUF at 65,536 context, using Vulkan backend; the 92 GB model fits in 128 GB unified memory. Halogen Flash Server shows 2-4x faster prefill (453-1,203 t/s) but accuracy collapses to 65.2% without its proprietary overlay, and it forces thinking mode.