Qwen3 4B
on AMD Ryzen AI Max+ 395 / Radeon 8060S (Strix Halo; installed RAM unknown) · llama.cpp
Summary
User reports Qwen3-4B Q8_0 at 44.6 t/s generation and 852.6 t/s prompt processing on an AMD Ryzen AI Max+ 395 with Radeon 8060S.
Setup is llama.cpp with Q8_0 and F16 K/V cache, one GPU, 16 threads, flash attention, ngl=99, 4096-token prompt and 512-token generation tests.
The figures are separate synthetic llama-bench runs, not one chat: PP4096 852.58 ± 15.72 t/s and TG512 44.57 ± 0.38 t/s over five repetitions, with no speculative decoding or concurrency.