llamaperf

NVIDIA RTX 3080 Laptop 16GB reports

3 reports. These are individual setups, not a controlled benchmark. NVIDIA RTX 3080 Laptop 16GB speeds and models →

Speeds are as each source reported them. GPU count, offloading and concurrent requests change them, and prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing two reports.

Tone: positiveNVIDIA hardware
generation:
60-70 tokens/s
quant:
IQ3_S (GGUF)

User reports Qwen3.8 Flash-Next at 60-70 tok/s on an RTX 3080 Mobile 16GB in an MSI Raider laptop with 64GB DDR4 3200 RAM running CachyOS. Setup is Strata with IQ3_S weights. The speed varies by task, so the figure is given as a range.

Nov 15, 2026
Tone: positiveNVIDIA hardware
generation:
11.1 tokens/s

User reports Qwen3.8 Flash-Next 176B at 11.09 tok/s decode on an RTX 3080 Laptop 16GB with 32GB system RAM and SSD. Setup is TensorSharp with MoE-aware unified scheduling across cache, VRAM, system RAM, and SSD; quant and context length not stated. User compares against Strata, which reached 10.24 tok/s decode and 62.15s whole-process time versus TensorSharp's 16.54s; TensorSharp GPU peak was 14,832.5 MiB and OS peak working set 19.74 GiB.

Oct 3, 2026
NVIDIA hardware
generation:
10-20 tokens/s
prompt processing (prefill):
100-200 tokens/s

User reports running Qwen3.8-Flash-Next on an RTX 3080 Laptop GPU with 16GB VRAM at roughly 10-20 tok/s generation and an estimated 100-200 tok/s prompt processing, with about 65k context and only 1-2GB system RAM usage. Setup uses a modified llama.cpp. The prompt processing figure is an estimate based on cloud GPU calculations, not a direct measurement on the laptop. The user was mid-benchmark when their 180W power adapter cable failed and is asking for donations to replace it, promising to release the technique and source code regardless.

Sep 29, 2026