llamaperf

Inkling-2 Mini

on AMD Radeon AI PRO R9700 32GB · llama.cpp

Tone: mixedAMD hardware
Nov 21, 2026
Throughput
30.0 t/s gen
Quant
Q8_0 (GGUF)
VRAM reported
32 GB

Summary

User reports Inkling-2-Mini at about 30 tok/s on a single Radeon AI PRO R9700, which they call pretty slow. Setup is llama.cpp built from source with the Q8_0 GGUF from ggml-org; the model only runs on one card. The unsloth Q8_K_XL build did not work with the latest llama.cpp, and its Mainline_Support variant produced gibberish.