Qwen3.8 27B
on NVIDIA RTX 3080 20GB · llama.cpp · 98,304 ctx
Oct 8, 2026
Use cases
codinglong-context
Summary
User benchmarks Qwen3.8 27B at ~31.3 t/s generation and ~997 t/s prompt processing on a single modded RTX 3080 20GB.
Setup is llama.cpp with Q4_K_XL GGUF and Q8_0 KV cache at ~98k context. Native MTP raises generation to ~56.9-60.7 t/s but cuts context to ~68k.
Adding an RTX 3070 8GB via layer split reaches ~223k context but drops generation to ~27.8 t/s; tensor parallelism over the chipset x4 slot hits ~59.7 t/s generation with a ~20% prompt-processing penalty, while moving the second card to a CPU-attached Oculink x4 link recovers ~976-1,005 t/s prompt processing at ~60.4 t/s generation and ~204k context.