Qwen
on AMD Strix Halo 128GB · llama.cpp · 32,768 ctx
Use cases
coding
Summary
User reports a Qwen model running on a Bosgame M5 with 128GB (Strix Halo) under ROCm, reading a VS Code Copilot prompt.
Setup is a franken-llama build assembled from various sources; prompt processing at 32k context reaches 950 t/s.
Generation speed is described as nothing to write home about, with no figure given.