Unknown family
- generation:
- 38.0 tokens/s
User reports about 38 t/s average generation on 2x P100, with 60+ t/s on some tasks when MTP is enabled. Prefill is about 200 t/s, which the user calls painfully slow; the system draws 500W under load. The user says it works but is basically unusable for anything interactive and asks whether prefill can be sped up on this old hardware.