llamaperf

Qwen3.8 27B

on M2 Pro 32GB · llama.cpp · 131,072 ctx

Tone: mixedApple hardware
Sep 7, 2026
Throughput
8.6 t/s gen · 21.9 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ4_XS (GGUF)
System RAM
32 GB

Use cases

codingvision

Summary

User reports Qwen3.8 27B IQ4_XS with vision projector on an M2 MacBook Pro 32GB, at 21.9 t/s prompt and 8.6 t/s generation. Setup is llama.cpp built from source, with context set to 128K due to memory constraints. User notes the model is slow on Mac but that thinking quality is good, and mentions previous experience with Qwen3.5 35B-A3B.