Qwen3.8 27B

Oct 13, 2026

Throughput

13.0 t/s gen · 125.6 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Quant

UD-IQ4_XS (GGUF)

KV cache

F16

System RAM

64 GB

Summary

User reports Qwen3.8-27B at 13 t/s generation and 125.6 t/s prompt processing on an M4 Pro with 64 GB unified memory. Setup is dasLLAMA version 16 with UD-IQ4_XS weights and f16 KV cache, one GPU, 640 positions allocated. The figures are native PP512 and TG128 means over five repetitions, not one 512-input/128-output request.