80.0 t/s gen · 1200.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
VRAM reported
24 GB
Summary
User compares an RTX 4090 and an RTX 5090 for speed factors.
User mentions Muse Glimmer as an alternative but has not benchmarked it.