llamaperf

DeepSeek V4 Flash 284B (13B active)

on M5 Max 128GB · DwarfStar · 100,000 ctx

Tone: mixedApple hardware
Sep 7, 2026
Quant
IQ2_XXS/Q2_K (GGUF)
System RAM
128 GB

Use cases

agentic

Summary

User compares DeepSeek-V4-Flash on an M5 Max MacBook with 128 GB against 2x DGX Spark. Terminal-Bench 2.1 scores 54% (47/87) on the Mac and 52% (45/86) on the Spark pair. The Mac runs a heavily quantized GGUF at IQ2_XXS/Q2_K, about 2.45 bits per weight. The Spark pair runs the native FP8/FP4 checkpoint. The Mac wins 11 tasks outright and the Spark pair 9, with no significant difference in task-solving. The Spark pair offers higher speed at 54-58 tok/s single-stream and 253 tok/s aggregate at concurrency 8, plus a larger 262K server context window.