llamaperf

Xyntetik-Kvist 14.44B

on NVIDIA RTX 3070 · Xyntetik Runner

Tone: positiveNVIDIA hardware
Oct 9, 2026
Throughput
5.0 t/s gen
Quant
IQ4_NL (GGUF)

Use cases

tool-useagentic

Summary

User reports Xyntetik-Kvist-14B at ~5 tok/s on an RTX 3070 with 50 of 52 layers offloaded. Setup is Xyntetik Runner with an IQ4_NL mix (7.6 GB) that does not fit an 8 GB card whole. The model is a width-pruned and distilled version of Muse-Glimmer-30B, scoring 57 of 60 held-out tool tasks against the parent's 60, with KLD 0.762 and 84.0% top-1 agreement. It also runs at Q8_0 (15.4 GB) or Q5_0 mix (10.3 GB) on a 24 GB card.