Poolside Laguna S 2.1 118B (8B active)
on NVIDIA RTX 4060 Ti 16GB · floatie · 128,000 ctx
Oct 12, 2026
Summary
User reports Poolside Laguna S 2.1 IQ3_S at 11 tok/s decode and 744 tok/s prefill at 128K context on an RTX 4060 Ti 16GB with 128GB DDR4 and a Threadripper 1950x.
Setup uses the user's own floatie engine, an attempt to replicate Strata's partial-offload approach, with OMP.
User compares against Qwen3.8-Flash-Next-UD-Q4_K_XL at 18.2 tok/s and Qwen3.8-Flash-Next-GSQ-RCO-IQ3_S at 35.8 tok/s on the same task; the Laguna run finished in 84 min with 4 bugs found in review versus 30 min/1 bug and 20 min/4 bugs for the Qwen runs. User says they will not pursue this further.