llamaperf

Strata on the AMD Radeon AI PRO R9700 32GB

llamaperf has 5 Strata reports on the AMD Radeon AI PRO R9700 32GB, none of them a plain single-card run with a model size and quant, so there is no median to quote. The reports are listed below with how each one ran.

5 Strata reports on the AMD Radeon AI PRO R9700 32GB

Newest first. A run on several cards, with speculative decoding, with part of the model in system RAM or with batched requests says so, since each describes a different setup. Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.

Filter these reports on the homepage

Frequently asked

How fast is Strata on the AMD Radeon AI PRO R9700 32GB?

llamaperf has 5 Strata reports on the AMD Radeon AI PRO R9700 32GB, none of them a plain single-card run with a model size and quant, so there is no median to quote. The reports are listed below with how each one ran.