Qwen3.8 27B
on 3× NVIDIA RTX A4000 16GB · llama.cpp · 128,000 ctx
Use cases
coding
Summary
User reports Qwen3.8 27B at ~23 t/s on 3x RTX A4000 16GB.
Setup is llama.cpp with Q8_0 quantization, MTP draft mode and ngram speculative decoding.
User asks for optimization advice.