Strata on the NVIDIA RTX 5080
llamaperf has 7 Strata reports on the NVIDIA RTX 5080, none of them a plain single-card run with a model size and quant, so there is no median to quote. The reports are listed below with how each one ran.
7 Strata reports on the NVIDIA RTX 5080
Newest first. A run on several cards, with speculative decoding, with part of the model in system RAM or with batched requests says so, since each describes a different setup. Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
- Qwen3.8 125B · 6B active · UD-IQ4_XS50.0 t/s(part in system RAM)
- Model not identified · IQ3100.0 t/s
- Qwen3.8 125B · 6B active75.0 t/s(part in system RAM)
- Qwen3.8 125B · 6B active · IQ3_SPP 5500.0 t/s(part in system RAM)
- Qwen3.8 125B · 6B active · IQ3_XXS150.0 t/s(speculative decoding, part in system RAM)
- Qwen3.8 125B · 6B active · UD-Q4_K_XL110.6 t/s(2 cards, speculative decoding, part in system RAM)
- Qwen3.8 125B · 6B active · IQ2_XSPP 1940.0 t/s(2 cards, speculative decoding, part in system RAM)
Frequently asked
How fast is Strata on the NVIDIA RTX 5080?
llamaperf has 7 Strata reports on the NVIDIA RTX 5080, none of them a plain single-card run with a model size and quant, so there is no median to quote. The reports are listed below with how each one ran.