llamaperf

Qwen3.8 27B

on 2× NVIDIA RTX 3090

Tone: positiveNVIDIA hardware
Sep 7, 2026
Throughput
30.0 t/s gen · 560.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8_0 (GGUF)
VRAM reported
24 GB

Summary

User reports Qwen3.8-27B at 560/30 t/s on 2x RTX 3090. Setup is Q8_0 quantization, run fully in VRAM. The user calls it the local king and praises its quality. Other models mentioned are DeepSeek-V4-Flash, GLM-5.3-Flash, and Qwen3.8-Flash-Next.