llamaperf

NVIDIA A10G vs NVIDIA DGX Spark for local LLMs

0 reports on the NVIDIA A10G and 57 on the NVIDIA DGX Spark

Which is faster for local LLMs?

Nobody has reported the same model at the same quant on both cards yet, so there's no measured head-to-head. Memory bandwidth, which caps how fast a card can write, is 2.2x higher on the NVIDIA A10G (600 GB/s on the NVIDIA A10G, 273 on the NVIDIA DGX Spark). The estimates below compare them on the models people run most.

NVIDIA A10G
Memory
24GB
Memory bandwidth
600 GB/s
FP16 compute
70 TFLOPS
Reports
0
NVIDIA DGX Spark
Memory
128GB unified
Memory bandwidth
273 GB/s
FP16 compute
125 TFLOPS
Reports
57

Estimated by the calculator

The quant the calculator recommends for each card and its estimated speed at a 32,768-token context with 32 GB of system RAM, from memory bandwidth and the model's shape.

ModelNVIDIA A10GNVIDIA DGX Spark
Qwen3.8 27B21.7 t/sQ4_K_M4.0 t/sFP16
Qwen3.8 125B · 6B active18.5 t/sQ2_K, experts in RAM14.4 t/sQ6_K
DeepSeek V4 Flash 284B · 13B activedoesn't fit at these settings38.3 t/sQ2_K
Qwen3.6 35B · 3B active77.0 t/sQ4_K_S14.5 t/sFP16
Qwen3.6 27B21.7 t/sQ4_K_M4.0 t/sFP16
Gemma 4 26B · 4B active49.0 t/sQ5_K_S10.8 t/sFP16

Change the context, RAM or model in the calculator: NVIDIA A10G · NVIDIA DGX Spark

Every report on each card, with its source: NVIDIA A10G · NVIDIA DGX Spark

More comparisons