llamaperf

Qwen3.8

on AMD Strix Halo 128GB · 1,000,000 ctx

Tone: mixedAMD hardware
Sep 7, 2026
Throughput
45.0 t/s gen
Quant
Q4_K_M (GGUF)
KV cache
Q4
System RAM
128 GB

Summary

User reports Qwen3.8 Q4_K_M at 1M context on an AMD Strix Halo 128GB with an eGPU RTX 3080 Ti 12GB over Oculink, reaching about 45 t/s. Setup splits layers: 2GB of weights and FastMTP on the 3080, the rest on the iGPU. At 262K context, Q6 gives 10 t/s on the Strix alone, 24 t/s with MTP n=4, and about 28 t/s with FastMTP offloaded to the 3080. Q4_K_M at 262K context with 5GB of weights and FastMTP on the 3080 gives about 53 t/s. The user notes 60-70GB free on the AMD, enough to load an embedding and reranker, and compares to Qwen3.6-35B on 4x3090 at 450 t/s.