llamaperf

Qwen3.8 Swift 1.5 Flash-Next custom Q8T

on 2× Mixed AMD GPUs (one Strix Halo APU and one Radeon Pro V620) · llama-halo-hybrid (llama.cpp fork) · 131,072 ctx

Oct 13, 2026
Throughput
58.2 t/s gen
Quant
Custom Q8T (GGUF)
Flash Attention
on
MTP (Multi-Token Prediction)
on

Summary

User reports Qwen3.8 at 58.2 t/s on one Strix Halo APU/iGPU plus one Radeon Pro V620 with 32 GB VRAM over PCIe Gen4 x4. Setup is the llama-halo-hybrid HIP/ROCm fork with a Custom Q8T merge, 131072-token context, one slot, -fa on, -ngl 999 and draft-mtp with at most two draft tokens. The 58.2 t/s is the single-stream median of 40 real category prompts, not a token-weighted aggregate, with prefix caching disabled and dense trunk, KV and draft on the card and routed experts on the iGPU.