Use cases
math
Summary
User reports running a quant of Qwen3.8 27B on an RTX 3090, getting around 50 t/s. The model was benchmarked on a noisy data science prediction problem against cloud models Luna 5.6 and Astra, where it performed better than Luna and competitively with Astra. The user notes the local model took 5-15 times longer than the cloud models.