Strata

User reports Strata at iq2_xxs quant running at about 30 t/s on 2x RTX 3060 12GB, comparable to vanilla llama.cpp with Qwen3.8 27B. Peak speeds reach up to 50 t/s when working with code. Setup is llama.cpp with iq2_xxs quant, 48GB system RAM, Ryzen 5 3600, and Pi Harness. User notes the larger model offers better quality even at this quant, but it loops badly and fails to complete meaningful tests, becoming indecisive and going in circles without producing output.