Qwen3.8 27B dense

Oct 9, 2026

Throughput

21.3 t/s gen · 143.7 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Quant

Q4_K_M (GGUF)

MTP (Multi-Token Prediction)

off

System RAM

64 GB

Summary

User reports Qwen3.8-27B at 21.3 t/s generation and 143.7 t/s prefill on an M4 Max 64GB Mac Studio. Setup is ZINC with Metal backend, GGUF Q4_K_M, 48 prompt tokens and 96 generated tokens. Figures are source-published medians from three CLI invocations after one discarded warmup. No speculative decoding is reported. The source warns that 16 of 20 Metal rows have different prompt-token counts between ZINC and llama.cpp, and this submission makes no matched-workload comparison claim.