llamaperf

Qwen3.8 27B

on NVIDIA RTX 3090 · 180,224 ctx

Tone: positiveNVIDIA hardware
Sep 26, 2026
Throughput
45-60 t/s gen · 1000-1500 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
KV cache
Q8_0

Use cases

coding

Summary

User reports running Qwen3.8-27B on a dedicated headless RTX 3090 for coding work, with 1000-1500 t/s prefill and 45-60 t/s generation at 180224 context with Q8_0 KV cache. Setup uses one RTX 3090; the user says it replaced cloud subscriptions for most real coding tasks. The user also ran Ornith-1.5-9B on a home server with 8GB VRAM and found it successful on simple Python refactoring tasks, but has not benchmarked it and asks for others' real coding experience.