Poolside Laguna S 2.1 118B (8B active)
NVIDIA RTX 4060 Ti 16GB · floatie · 128,000 ctx
- generation:
- 11.0 tokens/s
- prompt processing (prefill):
- 744.0 tokens/s
- quant:
- IQ3_S (GGUF)
Reported by the source; GPU count, offloading and concurrent requests can change these figures. Prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing.
User reports Poolside Laguna S 2.1 IQ3_S at 11 tok/s decode and 744 tok/s prefill at 128K context on an RTX 4060 Ti 16GB with 128GB DDR4 and a Threadripper 1950x. Setup uses the user's own floatie engine, an attempt to replicate Strata's partial-offload approach, with OMP. User compares against Qwen3.8-Flash-Next-UD-Q4_K_XL at 18.2 tok/s and Qwen3.8-Flash-Next-GSQ-RCO-IQ3_S at 35.8 tok/s on the same task; the Laguna run finished in 84 min with 4 bugs found in review versus 30 min/1 bug and 20 min/4 bugs for the Qwen runs. User says they will not pursue this further.