llamaperf

Qwen3.8 27B

on 2× NVIDIA RTX 4090 · 131,072 ctx

Tone: mixedNVIDIA hardware
Oct 27, 2026
Throughput
80.0 t/s gen
Quant
Q4_K_M (GGUF)
System RAM
128 GB

Use cases

codinglong-context

Summary

User reports running Qwen3.8 27B at an average generation speed near 80 t/s on a workstation with 2x RTX 4090 and 128 GB DDR5. Setup uses a K_M quant with a 128k context size; the harness is pi, dsh or qwen code, with dsh judged worse than the other two. The user compares it unfavourably with a free hosted DeepSeek Flash, which solved their data collection, figure and table preparation and LaTeX assembly tasks much faster and with better results, and asks whether local models are still worth it.