NVIDIA RTX A3000 Laptop 12GB

NVIDIA · 12GB · 1 report

See reported performance Estimate what fits

How to compare these reports →Filter reports by setup →Best local LLMs for 12 GB of VRAM →

Run models on your NVIDIA RTX A3000 Laptop 12GB? Add your numbers.

Your coding agent can run a speed test on your machine and send it here with a free account. Or paste a result you've already posted.

Benchmark with your agent Paste a result

Reported performance on the NVIDIA RTX A3000 Laptop 12GB

These reports mix GPU counts and memory setups, so a model listed here may have needed extra cards or CPU offloading. The calculator estimates which models fit in 12 GB of VRAM.

This page is thin (1 of 3 reports needed for indexing). Help fill it in.

Date ↓Date ↑Token speed ↓Token speed ↑Prefill ↓Prefill ↑Context ↓Context ↑Ranked

Qwen3.8 27B

2× NVIDIA RTX A3000 Laptop 12GB · 163,000 ctx

generation:: 20.0 tokens/s
prompt processing (prefill):: 450.0 tokens/s
quant:: IQ3_S (GGUF)

Reported by the source; GPU count, offloading and concurrent requests can change these figures. Prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing.

User reports Qwen3.8 27B at 20 t/s generation and 440-460 t/s prompt processing at 163k context. Setup runs on an RTX A3000M 12GB plus an RTX A2000M 8GB with P2P inside a NAS, using the GSQ-RCO IQ3_S quant. Prompt processing is given as a range of 460-440 t/s.

Get a weekly email of new NVIDIA RTX A3000 Laptop 12GB reports and newly released models that fit it.

Email me new reports

Reported configurations

Individual observations from this page, not expected speeds or a ranking. Select a model to open its report, with the source and offloading conditions. Reported context may be a limit rather than actual input length.

Model / hardware	Quant / engine	Reported context	Generation
Qwen3.8 27B 2× NVIDIA RTX A3000 Laptop 12GB	IQ3_S Engine not reported	163,000	20.0 tokens/s