llamaperf

Qwen3.8 27B

on 2× NVIDIA RTX 3090 · llama.cpp · 170,000 ctx

Tone: mixedNVIDIA hardware
Nov 10, 2026
Throughput
60.0 t/s gen
Quant
Q5 (GGUF)
System RAM
32 GB

Use cases

agentic

Summary

User reports running Unsloth's Qwen3.8 27B Q5 at around 60 tokens/sec with a 170K context window on an RTX 3090 plus RTX 3080 Ti. Setup is llama.cpp with a 32GB DDR4 system RAM configuration. User asks for advice on better hardware use and says agentic tasks such as generating and working with .docx files are painfully slow.