Gemma 4 26B (4B active)

User reports Gemma 4 26B-A4B-it NVFP4 at 48.2 t/s for a 1000-token generation on an NVIDIA DGX Spark (GB10 Blackwell, 128GB unified memory), against 23.3 t/s for the BF16 original. Setup is vLLM with an NVFP4 (W4A4) modelopt checkpoint and FP8 KV cache, single DGX Spark, Marlin MoE backend, 256K max context; the model loads at 15.7 GiB. TTFT is 53 ms versus 97 ms for BF16, and the checkpoint is ~16.5 GB on disk versus ~49 GB. Quality retention averages 97.6% across GSM8K and IFEval, with GSM8K down about 4 percentage points.