llamaperf

Poolside Laguna S 2.1 118B (8B active)

on NVIDIA RTX 4060 Ti 16GB · floatie · 128,000 ctx

Tone: mixedNVIDIA hardware
Oct 12, 2026
Throughput
11.0 t/s gen · 744.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ3_S (GGUF)
System RAM
128 GB
VRAM reported
16 GB

Summary

User reports Poolside Laguna S 2.1 IQ3_S at 11 tok/s decode and 744 tok/s prefill at 128K context on an RTX 4060 Ti 16GB with 128GB DDR4 and a Threadripper 1950x. Setup uses the user's own floatie engine, an attempt to replicate Strata's partial-offload approach, with OMP. User compares against Qwen3.8-Flash-Next-UD-Q4_K_XL at 18.2 tok/s and Qwen3.8-Flash-Next-GSQ-RCO-IQ3_S at 35.8 tok/s on the same task; the Laguna run finished in 84 min with 4 bugs found in review versus 30 min/1 bug and 20 min/4 bugs for the Qwen runs. User says they will not pursue this further.