Qwen3.8 27B

User benchmarks Qwen3.8-27B dense at 38.6 tok/s code generation on a single NVIDIA DGX Spark (GB10, 128 GB unified memory). Setup is SGLang with NVFP4 weights, fp8_e4m3 KV cache, 262144 context and DFlash2 speculative decoding with 8 draft tokens; the same machine also ran vLLM NVFP4 + MTP k3 at 24.5 tok/s and Ollama Q4_K_M at 10.3 tok/s. User reports speculative decoding degrades with context (accept rate 0.36-0.45 short vs 0.10-0.16 long reasoning, decode 27-33 vs 13-16 tok/s), that FP8 is 3x slower than Q4 on dense models (7.8 vs 23 tok/s), and that chat speed is only 15.9 tok/s versus 38.6 on code.