Summary
User reports Qwen3.8 Flash-Next 8-bit on 2 RTX Pro 6000 Blackwell GPUs at 150 t/s decode and 10K t/s prefill.
Setup uses peer-to-peer communication, CUDA graphs, tensor parallelism, and both GPUs capped at 500W. The user also runs DeepSeek V4 Flash 0731 with 1M context and room for 4 concurrent requests.
User finds the system fast and plans to cancel subscriptions; asks about excluding thinking tokens from Qwen context and other models to try.