50-70 t/s gen · 1000.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
VRAM reported
16 GB
Summary
User reports prefill around 1000 PP/s and decode 50-70 t/s with Qwen 3.6 35B-A3B on an RTX 5080 eGPU.
User asks about CPU instruction set differences for offloading.