Qwen3.8 Flash CIRU Orca v5.0, 64000-depth cached append
on AMD Strix Halo 128GB · CIRU v5 native HIP · 262,144 ctx
Use cases
long-context
Summary
User reports Qwen3.8-Flash-CIRU-STRIX-Orca v5.0 at 59.2 t/s generation and 780.1 t/s prompt processing on one AMD Ryzen AI Max+ 395 / Radeon 8060S system with 128 GiB shared unified memory.
Setup is CIRU v5 native HIP with compact indexed-affine routed experts at 4.5175 bpw, F16 target and draft attention cache, a matching Q8 Orca MTP drafter at depth 4, and 262144-token configured context.
The headline is one initial observation at 64,000-token prior prefix depth with 2,048 appended tokens and 512 output tokens, not an aggregate; the reversed-order repeat gave 903.82 t/s append and 58.67 t/s generation.