llamaperf

Qwen3.8 27B

on NVIDIA CMP 170HX 64GB (unlocked) · vLLM

Tone: positiveNVIDIA hardware
Aug 28, 2026
Throughput
3468.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
FP8
VRAM reported
64 GB

Summary

User reports an unlocked CMP 170HX, A100 silicon with a firmware unlock, reaching 193 TFLOPS tensor throughput, up from 6.3 TFLOPS. In llama.cpp, pp512 rises from 599.6 to 3468 tok/s. Serving Qwen3.8-27B-FP8 under vLLM, one 170HX beats a 2x3090 tensor-parallel pair on prefill at 197W versus 454W.