Qwen3.8 27B
on NVIDIA RTX 3090 · llama.cpp · 131,072 ctx
Use cases
codingagentic
Summary
User benchmarks Qwen3.8-27B (Q4_K_XL GGUF, 17.6 GB) at 40.9 tok/s decode on an RTX 3090 against a Mac mini M5 Pro 64GB at 15.6 tok/s.
Setup is llama.cpp with q8_0 KV cache, 131072 context, 256-token completions, prompts of about 8,300 tokens. Prefill was 1,150 to 1,210 tok/s on the 3090 and 322 to 339 tok/s on the Mac.
On a real agent task the 3090 finished in 59 min 51 s against the Mac's 3 h 7 min, writing 27.3 against 10.4 output tokens per second. MLX with nvfp4 weights decoded at 29.6 tok/s on the Mac, and MTP lifted the Mac's llama.cpp decode from 15.6 to 25.6 tok/s. The user calls the ratios rough, with one task and one run per machine.