llamaperf

NVIDIA CMP 170HX 40GB (unlocked) reports

3 reports. These are individual setups, not a controlled benchmark. NVIDIA CMP 170HX 40GB (unlocked) speeds and models →

Speeds are as each source reported them. GPU count, offloading and concurrent requests change them, and prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing two reports.

NVIDIA hardware
generation:
96.9 tokens/s
quant:
UD-Q4_K_XL (GGUF)
kv:
q8_0
long-contextagentic

User reports Qwen3.8-Flash-Next at 96.9 tok/s single-request decode on four NVIDIA CMP 170HX 40GB cards. Setup is llama.cpp with UD-Q4_K_XL weights, q8_0 KV cache, MTP speculative decoding (draft length 4, GPU sampling), 262K context, and the SM clock pinned at 1410 MHz. The same configuration reaches 87.7 tok/s at 70K context; three concurrent 3K requests give 34-37 tok/s each (about 100 tok/s aggregate). Earlier revisions of the fork measured 64-73 tok/s at 2K and 58-70 tok/s at 70K, against a baseline fork at 46-55 tok/s and 27-45 tok/s respectively.

Sep 27, 2026
Tone: positiveNVIDIA hardware
generation:
225.0 tokens/s
quant:
W4A16
kv:
fp8

User reports Qwen3.8 27B at around 225 t/s on a single CMP 170HX with 40GB VRAM at 132k context. Setup is vLLM with W4A16 4-bit weights and an fp8 KV cache. The GPU is overclocked to NDIV 60, giving 1.89 TB/s memory bandwidth at around 1500 MHz, and has been stable for over a week at 65-67C. The user also runs Minimax H3 for video generation on the same card and notes NDIV 62 crashes while NDIV 60 is stable.

Sep 24, 2026
Tone: positiveNVIDIA hardware
generation:
202.0 tokens/s

User reports Qwen3.8 27B token generation rising from 110 T/S to 202 T/S on a CMP 170HX 40GB after overclocking. Nothing changed except the overclock, which raised memory bandwidth from 1,386.2 GB/s to 1,890.1 GB/s, a +36.4% increase. GPU wattage is 300 watts and GPU temps are slightly lower after the overclock.

Sep 20, 2026