llamaperf

Qwen3.8 27B

on NVIDIA RTX 5090 · crit · 262,000 ctx

Tone: positiveNVIDIA hardware
Oct 20, 2026
Throughput
216.0 t/s gen · 8917.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
VRAM reported
32 GB

Summary

User reports an engine built with the crit toolkit running Qwen3.8-27B at 216 tok/s decode and 8,917 tok/s prefill on an RTX 5090. Setup is a from-scratch engine generated by Claude Opus 5.5 from the crit repository, with 262K context and +0.3% perplexity versus the reference. The build took 3.5 hours with almost no intervention, and the user says it performs in the same league as dedicated engines like NInfer.