llamaperf

Qwen3.8 27B

on NVIDIA RTX 3090 · llama.cpp · 131,072 ctx

NVIDIA hardware
Oct 21, 2026
Throughput
40.9 t/s gen · 1150-1210 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_XL (GGUF)
KV cache
q8_0

Use cases

codingagentic

Summary

User benchmarks Qwen3.8-27B (Q4_K_XL GGUF, 17.6 GB) at 40.9 tok/s decode on an RTX 3090 against a Mac mini M5 Pro 64GB at 15.6 tok/s. Setup is llama.cpp with q8_0 KV cache, 131072 context, 256-token completions, prompts of about 8,300 tokens. Prefill was 1,150 to 1,210 tok/s on the 3090 and 322 to 339 tok/s on the Mac. On a real agent task the 3090 finished in 59 min 51 s against the Mac's 3 h 7 min, writing 27.3 against 10.4 output tokens per second. MLX with nvfp4 weights decoded at 29.6 tok/s on the Mac, and MTP lifted the Mac's llama.cpp decode from 15.6 to 25.6 tok/s. The user calls the ratios rough, with one task and one run per machine.