Qwen3-Coder 30B (3B active)
on NVIDIA RTX 5090 Laptop 24GB · llama.cpp · 65,536 ctx
Use cases
codingagentic
Summary
User reports Qwen3-Coder-30B-A3B-Instruct at 107.0 tok/s generation and 3,706.5 tok/s prefill on an RTX 5090 Laptop 24GB in an MSI Raider A18.
Setup is llama.cpp with CUDA, Q4_K_M GGUF (17.28 GiB), Q8_0 KV cache, FlashAttention on, 65,536-token context, all layers on the GPU, one slot.
The figures come from a repository-analysis workload with an 8,638-token prompt and 371 generated tokens; the user notes the screenshot captures one strong interval, not an average across the audit.
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.
Qwen3-Coder 30B · 3B active at 4-bit by hardware
- 107.0 t/s · one run
- 70.3 t/s · 2 runs
- 69.9 t/s · 6 runs
- 66.1 t/s · one run
Bars are medians on one scale, 0 to 107.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Models most run on the NVIDIA RTX 5090 Laptop 24GB
- Qwen3.8 27B4-bit33.5 t/s · 2 runs
- Qwen3 14B4-bit3.6 t/s · one run
- 107.0 t/s · one run
Bars are medians on one scale, 0 to 107.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Everything reported on the NVIDIA RTX 5090 Laptop 24GB →Every Qwen3-Coder report →Estimate Qwen3-Coder on this card →