llamaperf

DeepSeek V4 Flash 284B (13B active)

on 2× NVIDIA RTX 3060 12GB · Unsloth Studio

NVIDIA hardware
Sep 7, 2026
Throughput
3.5 t/s gen
Quant
IQ2_M
System RAM
96 GB
VRAM reported
12 GB

Use cases

coding

Summary

User reports a dual RTX 3060 setup with RAM offloading, a Ryzen 7500F and 96 GB of 5600 RAM, writing a tetris game. Prompt eval runs at 3.0 tok/s. Generation is reported as 4.5 tok/s in the summary but 3.5 tok/s in PowerShell, and the user trusts PowerShell. LM Studio failed to offload to the second GPU, so the user used Unsloth Studio.