DeepSeek V4 Flash 284B (13B active)
on Unknown GPU · ExLlamaV3 · 200,000 ctx
Use cases
codingtool-uselong-context
Summary
User reports an exl3 2.52 bpw quant of DeepSeek V4 Flash at about 60 t/s decode on VRAM-only, handling contexts above 200k.
The user compares it to a slower MXFP4 version on unified RAM and notes it performs well in opencode.
The user asks which tasks are most quantization-fragile.