llamaperf

Inkling-2 Mini

on Strix Halo 8060S 128GB · Loom

Tone: positive
Nov 21, 2026
Throughput
44.8 t/s gen · 1427.0 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
Quant
UD-Q4_K_XL (GGUF)
System RAM
128 GB

Summary

User reports Inkling-2-Mini at 44.8 t/s decode on a Strix Halo 8060S with 128 GB, against 23.8 t/s for llama.cpp ROCm and 20.8 t/s for llama.cpp Vulkan on the same GGUF weights. Setup is Loom with the unsloth UD-Q4_K_XL GGUF, single stream; prefill at ~1k is 1,427 t/s versus 356 t/s for llama.cpp ROCm. Decode is said to reach ~80% of the memory-bandwidth roofline (228 GB/s ÷ ~4 GB read per token ≈ 56 tok/s). At ~2k context decode is 40.8 t/s and prefill 1,496 t/s; prefill at ~9k is 1,550 t/s and at ~18k 1,465 t/s. Four streams aggregate 100.8 t/s. The package was produced by Gemini 4 Neon driving the loom-skills playbook in about 4.3 hours and ~490 tool calls, gated against llama.cpp with token-level goldens up to 37k tokens. Speculative decoding with dspark is still a work in progress.