Use cases
long-contextsummarization
Summary
User reports Raon-1 mini preview at 96 tok/s on an RTX 3090 while running a Korean RAG benchmark over 300 questions and 64 PDFs.
Setup details are not stated; the run used the same top 5 retrieved pages and prompt for every model, with thinking on and temp 0.
Raon-1 scored around 74-75% and looped on 16 of 320 questions at temp 0 with thinking on. Qwen3.8 27B scored 77.3% versus Opus 5.5 at 76.6% (p=0.82 on McNemar), and thinking off dropped Qwen about 6 points. gpt-oss 20B went from 57.5% to 69.6% after raising the token limit from 1024 to 8192. BM25 hit@5 was 56% with whitespace splitting and 80% with a Korean morphological tokenizer. The user notes 11 verdicts flipped across hardware, so a 1 point gap means nothing.