DeepSeek V4 Flash 284B (13B active)
on NVIDIA RTX 3090 · llama.cpp · 196,608 ctx
Summary
User benchmarks DeepSeek V4 Flash GGUF in IQ3_XXS-AS and IQ2_S quants on an RTX 3090 with 128 GB DDR4.
Setup is mainline llama.cpp b10064, which matches the fairydreaming fork's performance.
User prefers IQ3_XXS-AS as the sweet spot.