Qwen3.8 27B
on 2× RTX 5060 Ti · vLLM · 130,000 ctx
Use cases
coding
Summary
User reports Qwen3.8 27B at 75 t/s decode on 2x RTX 5060 Ti (32GB total VRAM), with a peak of 120 t/s.
Setup is vLLM with NVFP4 weights, serving 2 concurrent requests at 130k context.
User also tried Swift 1 and 1.5 with no noticeable improvement and a context penalty, and finds the model's coding output mediocre for bounded tasks.