llamaperf

Qwen3.8 27B

on NVIDIA RTX 3080 20GB · llama.cpp · 98,304 ctx

Tone: positiveNVIDIA hardware
Oct 8, 2026
Throughput
31.3 t/s gen · 997.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_XL (GGUF)
KV cache
Q8_0
System RAM
32 GB
VRAM reported
20 GB

Use cases

codinglong-context

Summary

User benchmarks Qwen3.8 27B at ~31.3 t/s generation and ~997 t/s prompt processing on a single modded RTX 3080 20GB. Setup is llama.cpp with Q4_K_XL GGUF and Q8_0 KV cache at ~98k context. Native MTP raises generation to ~56.9-60.7 t/s but cuts context to ~68k. Adding an RTX 3070 8GB via layer split reaches ~223k context but drops generation to ~27.8 t/s; tensor parallelism over the chipset x4 slot hits ~59.7 t/s generation with a ~20% prompt-processing penalty, while moving the second card to a CPU-attached Oculink x4 link recovers ~976-1,005 t/s prompt processing at ~60.4 t/s generation and ~204k context.