Qwen3.8 27B
on Instinct MI100 32GB
Summary
User reports 20 t/s with Qwen3.8-27b-ud-q4-k-xl on an MI100, and later 40 t/s with a dflash2 model.
User also reports Qwen3.6-35b-a3b-ud-q5_k_m at 60 t/s max at 64k context.
User is frustrated with the performance compared to expectations.