llamaperf

Ling-3.0 7.9B (1.3B active) Tiny

on NVIDIA T1000 8GB · llama.cpp · 16,384 ctx

Tone: negativeNVIDIA hardware
Sep 20, 2026
Throughput
54.0 t/s gen · 245.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
System RAM
93 GB
VRAM reported
8 GB

Use cases

tool-uselong-context

Summary

User benchmarks Ling 3.0 tiny against Gemma 4 26B-A4B for batched JSON speaker attribution on an NVIDIA T1000 8GB. Ling 3.0 tiny runs at 245 t/s prefill and 54 t/s decode, 1.8x faster end to end than Gemma. Setup is llama.cpp with the official Q4_K_M GGUF at 16384 context, all 25 layers on the GPU, no speculative decoding. Gemma uses UD-Q4_K_XL with experts in system RAM and an MTP draft head. Ling scores 56.9% exact speaker match versus Gemma's 94.6% across 485 lines, with narrator swaps and refusals. User is not adopting it.