Qwen3.8 27B
on AMD Radeon 780M · llama.cpp · 32,768 ctx
Use cases
codingmultilingual
Summary
User reports Qwen3.8-27B at 5.1-8.3 t/s generation and ~74 t/s prompt on a Radeon 780M laptop with 32GB unified RAM.
Setup is llama.cpp with IQ3_S quant, q8_0 KV cache, 32768 context, and DFlash2 speculative decoding.
User also ran Gemma 4 26B-A4B Q4_K_M at 21.8-25.8 t/s, Qwen3.6-35B-A3B IQ4_XS at 24.4-33.3 t/s, and LFM2.5-24B-A2B Q4_0 at 38.7-40.3 t/s. User plans to use Qwen3.8-27B for coding and Gemma 4 26B-A4B for other tasks.