Qwen3.8 27B
on Unknown GPU · llama.cpp · 130,000 ctx
Summary
User reports Qwen3.8-27B at about 20 t/s on 16 GB of VRAM at 130k context.
Setup is a PR that adds a --n-cpu-ffn option for dense models, with the Q4_K_M quant.
on Unknown GPU · llama.cpp · 130,000 ctx