llamaperf

NVIDIA B200 180GB

NVIDIA · 180GB · 1 report

Is this your card?

Engines people use on it: SGLang 1 (reports)

Run models on your NVIDIA B200 180GB? Add your numbers.

Your coding agent can run a speed test on your machine and send it here with a free account. Or paste a result you've already posted.

Reported performance on the NVIDIA B200 180GB

These reports mix GPU counts and memory setups, so a model listed here may have needed extra cards or CPU offloading. The calculator estimates which models fit in 180 GB of VRAM. Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.

One report on this card so far, so treat the figures as early. Add yours.

Speeds are as each source reported them. GPU count, offloading and concurrent requests change them, and prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing two reports.

Tone: positiveNVIDIA hardware
generation:
4.8 tokens/s
quant:
NVFP4
vision

User reports training a 40.1M connector to give DeepSeek V4 Flash basic vision, with the model loaded across four B200s in a custom SGLang stack. Training ran on 5x H200. User also trained a Laguna XS 2.1 version (33B total / 3B active) with a 30.7M connector, inspired by Baseten's GLM-5.2 Vision NVFP4.

Sep 7, 2026

Get a weekly email of new NVIDIA B200 180GB reports and newly released models that fit it.

Email me new reports

Reported configurations

Individual observations from this page, not expected speeds or a ranking. Select a model to open its report, with the source and offloading conditions. Reported context may be a limit rather than actual input length.

Model / hardwareQuant / engineReported contextGeneration
DeepSeek V4 Flash 284B (13B active)
4× NVIDIA B200 180GB
NVFP4
SGLang
Not reported4.8 tokens/s