Qwen3.8 Flash CIRU Orca v5.0, uncached 64000-token prefill

on AMD Strix Halo 128GB · CIRU v5 native HIP · 262,144 ctx

Oct 11, 2026

Throughput

1251.4 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Quant

CIRU v5 compact indexed affine (experts 4.5175 bpw) (GGUF)

KV cache

F16

MTP (Multi-Token Prediction)

System RAM

128 GB

Use cases

long-context

Summary

User reports Qwen3.8-Flash-CIRU-STRIX-Orca v5.0 at 1251.4 t/s prompt processing on one AMD Ryzen AI Max+ 395 / Radeon 8060S system with 128 GiB shared unified memory. Setup is CIRU v5 native HIP with compact indexed-affine experts at 4.5175 bpw, F16 target and draft attention cache, a Q8 Orca MTP drafter at depth 4, one slot and 262144-token configured context. The figure is a full-prefix prefill of 64,000 prompt tokens from zero cached prefix, not TTFT and not the later 2048-token cached append; a separate reverse-order 64K run measured 1267.40 t/s.