Inkling-2 Mini
on Strix Halo 8060S 128GB · Loom
Summary
User reports Inkling-2-Mini at 44.8 t/s decode on a Strix Halo 8060S with 128 GB, against 23.8 t/s for llama.cpp ROCm and 20.8 t/s for llama.cpp Vulkan on the same GGUF weights.
Setup is Loom with the unsloth UD-Q4_K_XL GGUF, single stream; prefill at ~1k is 1,427 t/s versus 356 t/s for llama.cpp ROCm. Decode is said to reach ~80% of the memory-bandwidth roofline (228 GB/s ÷ ~4 GB read per token ≈ 56 tok/s).
At ~2k context decode is 40.8 t/s and prefill 1,496 t/s; prefill at ~9k is 1,550 t/s and at ~18k 1,465 t/s. Four streams aggregate 100.8 t/s. The package was produced by Gemini 4 Neon driving the loom-skills playbook in about 4.3 hours and ~490 tool calls, gated against llama.cpp with token-level goldens up to 37k tokens. Speculative decoding with dspark is still a work in progress.