Qwen3.8 27B heretic-ara

on NVIDIA RTX 3090 · llama.cpp

Sep 7, 2026

Throughput

30-32 t/s gen

Quant

Q5_K_M (GGUF)

System RAM

64 GB

VRAM reported

24 GB

Summary

User reports Qwen3.8-27B-heretic-ara Q5_K_M GGUF at ~30-32 t/s on an RTX 3090 with 64 GB DDR4 RAM and an AMD 7950x CPU. Setup is llama.cpp.