67-84 t/s gen · 2570.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Rating
5/5
Summary
User reports sustained generation between 67-84 t/s, with prompt eval at 2570 t/s.