llamaperf

Qwen3.8 27B

on NVIDIA RTX 5090 · llama.cpp · 32,768 ctx

Tone: mixedNVIDIA hardware
Sep 7, 2026
Throughput
58.1 t/s gen · 479.2 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q6_K (GGUF)
KV cache
Q8
VRAM reported
32 GB

Use cases

creative-writing

Summary

User compares Qwen3.8-27B against Qwen3.6-27B on an RTX 5090. The user reports prefill and decode speeds at concurrency 1, and finds the subjective quality improvement smaller than benchmarks suggest. Medium reasoning used fewer tokens than low on 3 of 5 prompts. The concurrency knee sits at 3 requests for Qwen3.8 versus about 7 for Qwen3.6.