llamaperf

Qwen3.8 27B

on NVIDIA RTX 4090 · llama.cpp · 127,000 ctx

NVIDIA hardware
Oct 7, 2026
Throughput
80.0 t/s gen
Quant
Q4_K_M (GGUF)
System RAM
128 GB

Use cases

coding

Summary

User asks how a MacBook Pro M5 Pro 64GB would compare to their work setup of an RTX 4090 with 128 GB DDR5 for running local LLMs. They report running Qwen3.8-27B at Q4_K_M under llama.cpp on the RTX 4090 at roughly 80 t/s with a ~127k context window, though they note they are on holiday and cannot verify the figures. The question is whether to buy the 64GB or 32GB MacBook variant for local LLM use at home.