llamaperf

Qwen3.8 27B

on 2× NVIDIA RTX 5090 · vLLM

Tone: positiveNVIDIA hardware
Sep 7, 2026
Quant
FP8

Summary

User benchmarks 200 prompts at max concurrency 100, reaching 15,058.74 tok/s total token throughput and 1,673.19 tok/s output token throughput, with a peak output of 3,000 tok/s. Setup is vLLM with Model Runner V2, p2p enabled, and tensor parallel 2. Mean TTFT is 1,741.86 ms and mean TPOT is 45.74 ms. An AMD Radeon PRO W6600 is mentioned but not used for this benchmark.