llamaperf

Qwen3.8 27B

on M5 16GB · llama.cpp · 8,192 ctx

Apple hardware
Sep 9, 2026
Throughput
9.0 t/s gen
Quant
Q3_xxs
KV cache
8
System RAM
16 GB

Use cases

summarization

Summary

User asks whether about 9 t/s is normal for their setup, and is new to local LLMs. User also asks for model recommendations for PDF summaries on 16 GB of RAM.