Instinct MI300X 192GB

AMD · 192GB · 1 report

Use the calculator to check which models fit in 192 GB of VRAM. The reports below include different GPU counts and memory setups; a model listed here may need extra cards or CPU offloading.

How to compare these reports →

This page is thin (1 of 3 reports needed for indexing). Help fill it in.

Latest Most reported Fastest t/s

Qwen3.8 27B

Instinct MI300X 192GB · SGLang · 1,000,000 ctx

User reports Qwen3.8-27B at 495 t/s on a single MI300X at 1M context, up from 311 t/s. Setup is dstack's toolkit with source-level patches to SGLang's AITER attention backend. The figure is for four concurrent users at 10k in / 1.5k out, with p50 TTFT under 1.5s.