DeepSeek V4 Flash 284B (13B active)

on NVIDIA H100 80GB · vLLM

Sep 7, 2026

Throughput

193.0 t/s gen

Quant

W4A16-FP8

Use cases

agentic

Summary

User reports DeepSeek V4 Flash at 193 t/s on Hopper. Setup is vLLM with Canada-Quant quants and patched MTP code. User also reports roughly 400 t/s with 4 concurrent threads.

View source ↗