llamaperf

Qwen3.8 27B

on NVIDIA RTX 3090

Tone: positiveNVIDIA hardware
Oct 24, 2026
Throughput
96.0 t/s gen

Use cases

long-contextsummarization

Summary

User reports Raon-1 mini preview at 96 tok/s on an RTX 3090 while running a Korean RAG benchmark over 300 questions and 64 PDFs. Setup details are not stated; the run used the same top 5 retrieved pages and prompt for every model, with thinking on and temp 0. Raon-1 scored around 74-75% and looped on 16 of 320 questions at temp 0 with thinking on. Qwen3.8 27B scored 77.3% versus Opus 5.5 at 76.6% (p=0.82 on McNemar), and thinking off dropped Qwen about 6 points. gpt-oss 20B went from 57.5% to 69.6% after raising the token limit from 1024 to 8192. BM25 hit@5 was 56% with whitespace splitting and 80% with a Korean morphological tokenizer. The user notes 11 verdicts flipped across hardware, so a 1 point gap means nothing.