llamaperf

Qwen3.8 27B RVN Heretic (ARA abliterated)

on NVIDIA RTX 5090 · llama.cpp · 159,744 ctx

Tone: positiveNVIDIA hardware
Sep 16, 2026
Quant
Q6_K (GGUF)
KV cache
q8_0
VRAM reported
32 GB

Use cases

codingagenticvisiontool-uselong-context

Summary

User reports Qwen3.8-27B RVN Heretic (ARA abliterated) at 140-190 t/s on code and ~100 t/s on prose on a single RTX 5090 at 159,744 context. Setup is llama.cpp master with the Q6_K GGUF, q8_0 K/V cache, DFlash2 speculative decoding at n=4, vision projector on GPU, and Sharp chat template. Without speculation the same model runs at 62 t/s. Cold prefill measured without the drafter: 32K in 11.7 s, 64K in 28.6 s, ~113K in 60 s. VRAM is 29,996 MiB after load and 30,332 MiB after the first image. Tool calls parse and images read correctly with no Xid.