Gemma 4 26B (4B active) DiffusionGemma

User reports DiffusionGemma 26B-A4B at up to 114.6 t/s on Strix Halo 128GB, compared against GB10. Setup is Gufo with NVFP4 weights, 2K context, single request. Prefill reaches 3443 t/s at 2K and 1379 t/s at 121K. Time to first token is 5.5 s at 2K and 104.7 s at 121K. User compares to a llama.cpp Q8_0 run on the same hardware, where prefill is 978 t/s and TTFT 18.8 s at 2K. Against GB10 on SPEED-Bench prompts, Strix Halo is slower at 2K (114.6 vs 148.9 t/s) but faster at 32K (80.4 vs 77.9 t/s). User notes remaining headroom: FP8 denoising step at 134 ms against a 95 ms floor, expert weights streaming at 180-200 GB/s of 242 GB/s, dense products at 72% of matrix-unit floor, and 32K prefill at 40% of its floor.