Llama 3.2 3B
on Xbox Series S, Zen 2 CPU-only (6 threads) · llama.cpp · 2,048 ctx
Summary
User reports Llama 3.2 3B at 14.1 t/s generation and 21.2 t/s prefill on an Xbox Series S, CPU-only with six inference threads.
Setup is llama.cpp in xllama 1.6.0.1163 with Q3_K_S and a configured context of 2048, one sequential request per fresh app process.
The figures are medians of three recorded runs, with generation ranging 14.10-14.12 t/s; peak working set is 1827 MB per run.