llamaperf

Qwen3.8 27B

on NVIDIA RTX 4090 · llama.cpp · 131,072 ctx

Tone: mixedNVIDIA hardware
Sep 23, 2026
Throughput
23.0 t/s gen · 2248.6 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_XL (GGUF)
KV cache
Q8
System RAM
32 GB

Use cases

codinglong-context

Summary

User reports Qwen3.8 27B at 23.03 t/s generation and 2248.6 t/s prompt processing on a single RTX 4090 with 32 GB RAM. Setup is llama.cpp via llama-swap with the unsloth UD Q4_K_XL GGUF, a Q8 KV cache, 131072 context, and a BF16 mmproj for multimodal input; cache reuse is disabled because of the multimodal model. The user ran a three-day coding session in VS Code Copilot and hit a failure where the model emitted never-ending slashes; they ask what could cause it.