llamaperf

Qwen3.8 125B (6B active) Swift-1.5

on 2× NVIDIA DGX Spark · dgpp

Tone: mixedNVIDIA hardware
Oct 11, 2026
Throughput
55-60 t/s gen · 1900-2300 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
NVFP4 (NVFP4)

Use cases

agenticcoding

Summary

User reports quantizing ukisai's Swift 1.5 Qwen3.8-Flash-Next to NVFP4 for a 2x DGX Spark pair running stock dgpp-serve with TP=2. The 126 GiB checkpoint runs at ~55-60 tok/s C1 and ~114 tok/s C4 on prose, with prefill ~1.9-2.3k tok/s. Setup is dgpp with NVFP4 weights, 126 GiB, 296k tensors, 52 shards, no engine changes. The fine-tune is a reasoning-efficiency variant that cut output ~24% (805 to 611 tokens) on a chat probe with no speed loss, but savings are prompt-dependent and one zebra puzzle went up 39%; the upstream 31-57% thinking-token claim was not reproduced on a real eval suite.