llamaperf

Qwen3.8 27B

on NVIDIA RTX 3090 · Strata · 300,000 ctx

NVIDIA hardware
Oct 15, 2026
Throughput
32.0 t/s gen
System RAM
48 GB
VRAM reported
24 GB

Summary

User reports Qwen3.8-27B at 32 tok/s on a single RTX 3090 at 300k context. Setup uses Strata on the RTX 3090; a Titan RTX 24GB sits idle in the same machine, with 48GB of free system RAM. User asks whether Strata's multi-GPU support would hurt prefill speed when adding the second card without NVLink.