llamaperf

Inkling 2 Mini

1 report

Inkling 2 Mini VRAM requirements by size and quant →

How does Inkling 2 Mini run on your hardware?

Pick your GPU or Mac, then read the speeds people reported for Inkling 2 Mini on it, or estimate memory fit and speed.

Free to use. No account needed. Memory estimates and community measurements are labelled separately.

Run Inkling 2 Mini yourself? Add your numbers.

Your coding agent can run a speed test on your machine and send it here with a free account. Or paste a result you've already posted.

Reported performance for Inkling 2 Mini

Filter this model’s reports by setup →
Thin page (1 of 3 reports needed for indexing). Add yours.
Tone: positiveNVIDIA hardware
generation:
59.7 tokens/s
prompt processing (prefill):
1162.0 tokens/s
quant:
XQ (GGUF)

Reported by the source; GPU count, offloading and concurrent requests can change these figures. Prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing.

User reports Inkling 2 Mini at 59.7 t/s decode and 1,162 t/s prefill at 8K on a single RTX 4090. Setup is a custom engine written in Xolotl with a 13.9 GB GGUF quant of the abliterated model, which fits on the 24 GB card. The model is a 26B MoE with about 3B active parameters and a looped middle of 12 layers run 3 times per token. Held-out KL against the parent is 0.013 with 96.3% top-1 agreement; refusals were 4/100 on a harmful prompt set and 1/100 on harmless ones. The model's MTP drafter is an optional separate file and was not used for these figures. User expects 100+ t/s after fusing the many small per-token kernels.

Nov 21, 2026

Get a weekly email of new Inkling 2 Mini reports on any GPU.

Email me new reports

Reported configurations

Individual observations from this page, not expected speeds or a ranking. Select a model to open its report, with the source and offloading conditions. Reported context may be a limit rather than actual input length.

Model / hardwareQuant / engineReported contextGeneration
Inkling 2 Mini 26B (3B active) abliterated
NVIDIA RTX 4090
XQ
Xolotl
8,19259.7 tokens/s