llamaperf

DeepSeek V4 Flash 9B distill

on M5 Pro 48GB · Ollama · 16,384 ctx

Tone: mixedApple hardware
Sep 7, 2026
Throughput
44.0 t/s gen
Quant
Q4_K_M (GGUF)
System RAM
48 GB

Use cases

codingtool-usemath

Summary

User compares DeepSeek V4 Flash 9B distill against its base model Qwen3.5 9B on a MacBook Pro M5 Pro with 48 GB RAM. Both models gave the same answers on 6/8 tasks, but the distill used fewer tokens (5480 vs 8975). Throughput was near identical (44 vs 41 tok/s). The distill was slower on open-ended tasks (1467 tokens vs 867 for a buffer overflow explanation). The base model failed arithmetic due to a token cap.