llamaperf

Qwen3.8 27B

on M1 Max 64GB · Ollama · 65,536 ctx

Apple hardware
Oct 12, 2026
Throughput
12.0 t/s gen
Quant
Q4_K_M (GGUF)
System RAM
64 GB

Summary

User reports Qwen3.8 27B at 12 t/s on an M1 Max 64GB. Setup is Ollama with Q4_K_M and a 65,536-token context, one parallel request. The 12.0 tok/s is the second 6,872-token prompt run, not an aggregate; separate retrieval tests report prefill of roughly 90 tok/s at about 1,900 and 7,400 tokens, about 83 at 22,200, and 71-74 at 55,600.