llamaperf
Oct 12, 2026
Throughput
205.3 t/s gen
Quant
IQ3_S (GGUF)
VRAM reported
96 GB

Summary

User benchmarks Strata 0.1.39 against llama.cpp on Qwen3.8-Flash-Next (IQ3_S) on an RTX PRO 6000 Blackwell 96GB, reporting 205.263 tok/s generation at a 4K prompt versus 102.889 tok/s for llama.cpp. Setup is Strata with its draft head on, one request at a time, 256 tokens written greedy, median of three runs; the whole model sat on the card. Strata also led on a 3090 Ti (98.291 vs 22.490 tok/s) and a 5090 laptop (85.6 vs 24.4 tok/s), where the model did not fit and experts were kept in system RAM. Strata pins 46.84 GiB of system RAM for this file on every card.