Qwen3.8 125B (6B active) Swift-1.5
on 2× NVIDIA DGX Spark · dgpp
Use cases
agenticcoding
Summary
User reports quantizing ukisai's Swift 1.5 Qwen3.8-Flash-Next to NVFP4 for a 2x DGX Spark pair running stock dgpp-serve with TP=2. The 126 GiB checkpoint runs at ~55-60 tok/s C1 and ~114 tok/s C4 on prose, with prefill ~1.9-2.3k tok/s.
Setup is dgpp with NVFP4 weights, 126 GiB, 296k tensors, 52 shards, no engine changes.
The fine-tune is a reasoning-efficiency variant that cut output ~24% (805 to 611 tokens) on a chat probe with no speed loss, but savings are prompt-dependent and one zebra puzzle went up 39%; the upstream 31-57% thinking-token claim was not reproduced on a real eval suite.