llamaperf

Qwen3.8

on AMD Strix Halo 128GB · 262,144 ctx

Tone: positiveAMD hardware
Sep 9, 2026
Throughput
10.0 t/s gen
Quant
Q8
System RAM
128 GB
VRAM reported
128 GB

Summary

User reports Qwen 3.8 Uncensored Q8 at 256k context on the AI PC (Strix Halo) at ~10 t/s. Setup is a custom AI framework running across multiple devices. A Qwen3.6 35B MOE runs on an RTX 5090 at ~200 t/s, and a Gemma 4 model runs on a MacBook Air for security.