llamaperf

Qwen3.8 27B

on AMD Radeon 780M · llama.cpp · 32,768 ctx

Tone: mixedAMD hardware
Oct 14, 2026
Throughput
74.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ3_S (GGUF)
KV cache
q8_0
System RAM
32 GB
VRAM reported
4 GB

Use cases

codingmultilingual

Summary

User reports Qwen3.8-27B at 5.1-8.3 t/s generation and ~74 t/s prompt on a Radeon 780M laptop with 32GB unified RAM. Setup is llama.cpp with IQ3_S quant, q8_0 KV cache, 32768 context, and DFlash2 speculative decoding. User also ran Gemma 4 26B-A4B Q4_K_M at 21.8-25.8 t/s, Qwen3.6-35B-A3B IQ4_XS at 24.4-33.3 t/s, and LFM2.5-24B-A2B Q4_0 at 38.7-40.3 t/s. User plans to use Qwen3.8-27B for coding and Gemma 4 26B-A4B for other tasks.