llamaperf

Qwen3 30B (3B active)

on NVIDIA RTX 5070 Ti · Ollama · 8,192 ctx

Tone: mixedNVIDIA hardware
Oct 2, 2026
Throughput
108-110 t/s gen · 1683-4323 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
System RAM
31 GB
VRAM reported
16 GB

Use cases

codingagentic

Summary

User benchmarks Qwen3 30B-A3B at 108-110 t/s decode and 1683-4323 t/s prefill on an RTX 5070 Ti 16 GB. Setup is Ollama 0.35.0 with Q4_K_M at 8192 context, median of 2 runs, measured idle. The model produced no compilable code (0/2), failed one-word obedience with 899 characters, and returned 0 characters on the reasoning test after burning its 4000-token budget on 15088 characters of thinking. User notes prefill swings 2x with background load and that the fastest model here measures verbosity.