llamaperf

Qwen3.8 Flash-Next-Uncensored

on AMD Strix Halo 128GB · llama.cpp · 262,144 ctx

Tone: positiveAMD hardware
Sep 10, 2026
Throughput
21.5 t/s gen · 199.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q5_K_M (GGUF)
KV cache
f16
System RAM
128 GB

Use cases

visionlong-context

Summary

User benchmarks Qwen3.8-Flash-Next-Uncensored on a Bosgame M5 (128GB/2TB) running Fedora 44 with Vulkan driver 26.1.7, reaching 198.99 t/s prompt processing and 21.53 t/s generation at 200,000 context. Setup is a llama.cpp fork (strix-halo-qwen4exp-b10685) with the Q5_K_M quant and a shared-Q8_0 MTP draft model. llama-benchy results across context lengths: pp2048 460.38 t/s, tg512 34.86 t/s; pp4096 465.96 t/s, tg512 33.04 t/s; pp8192 437.14 t/s, tg512 31.18 t/s; pp16384 440.89 t/s, tg512 31.21 t/s; pp32768 407.48 t/s, tg512 29.65 t/s; pp65536 351.55 t/s, tg512 27.40 t/s; pp131072 265.54 t/s, tg512 23.87 t/s; pp200000 198.99 t/s, tg512 21.53 t/s. MTP acceptance rate stays at 80% even at context above 200K.