Unknown family
on 2× NVIDIA RTX 4090 · Strata · 524,288 ctx
Summary
User asks whether moving a helper RTX 2080 Ti from PCIe 3.0 x8 to a spare PCIe 3.0 x4 slot would improve token generation, with the RTX 4090 moving to full PCIe 4.0 x16.
Current setup is Strata with a Q4_K_XL quant at 512k context and default parameters, on a 5800X3D AM4 board.
User reports roughly 100 t/s prefill and 25 t/s generation, and asks whether the slot change would help or whether full tuning is needed. The model is not named.
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.
Models most run on the NVIDIA RTX 4090
- Qwen3.8 27B4-bit40.0 t/s · 3 runs
- 149.6 t/s · one run
- 129.0 t/s · one run
- Qwen2.5 7B4-bit158.9 t/s · one run
- Qwen3.6 27B4-bit25.0 t/s · one run
- Qwen3.8 27B4-bit35.9 t/s · one run
Bars are medians on one scale, 0 to 158.9 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.