Qwen3 8B
on M4 Max · Apple Core AI
Summary
User benchmarks Qwen 3 8B at 94.1 tok/s decode on an M4 Max (Mac Studio) under Apple's llm-benchmark protocol.
Setup is Apple Core AI with a 4-bit artifact, 512-token prompt and 1024 generated tokens, greedy, mean of 5 trials. MLX on the same protocol reaches 90.0 tok/s.
The report is a cross-runtime comparison of Apple Core AI against MLX and Core ML on Apple Silicon.