Qwen3.8 27B
on AMD Radeon AI PRO R9700 32GB · LemonSeed Engine · 131,072 ctx
Use cases
coding
Summary
User reports Qwen3.8-27B at 158.5 tok/s decode on a Radeon AI PRO R9700 in an iPad Pro eGPU enclosure.
Setup is LemonSeed Engine with Q4 weights and a Q8 DFlash2 draft, 131k context, speculative decoding on.
Baseline decode is 31.2 tok/s and MTP=3 gives 108.7 tok/s; prefill at 4K is 1,636 tok/s and 1,395 tok/s at 32K. On Strix Halo (Radeon 8060S) the same model reaches 64.4 tok/s decode and 517 tok/s prefill at 4K.