Qwen3.8 27B Swift-1.5
on NVIDIA Tesla P40 24GB · Polystrata
Summary
User reports Swift 1.5 Qwen 3.8 Flash Next at 19-20 tok/s on a Tesla M40 24GB in a Dell T420 with dual Xeon E5-2470 and 192 GB DDR3 RAM.
Setup is a Polystrata fork for the older CUDA compute capability, with IQ3_S weights; the GPU was limited to 180 watts.
GLM 5.3 Flash at IQ3_XXS ran 3-4 tok/s and the user suspects it was CPU bound, with GPU usage under 40%. Qwen 3.8 27B at UD_Q4_K_S ran 2-3 tok/s with 100% GPU offload.