llamaperf

Qwen3.8 27B

on NVIDIA RTX 3090 · ExLlamaV3 · 150,000 ctx

NVIDIA hardware
Oct 7, 2026
Throughput
60.0 t/s gen
Quant
exl3-5.00bpw (EXL3)
System RAM
32 GB

Use cases

codingtool-use

Summary

User reports Qwen3.8 27B at ~60 t/s on a single RTX 3090. Setup is ExLlamaV3 with an exl3-5.00bpw quant at ~150k context; prefill was not benchmarked. The machine has an Intel 12400 CPU and 32GB DDR4 RAM. User asks whether to buy 128GB DDR5 and a Ryzen 9700X to run the IQ3 quant under Strata, and how Qwen3.8 27B compares to Qwen Next on output accuracy for coding and Hermes assistant use.