Qwen3.8 27B
on NVIDIA RTX 3090 · llama.cpp
Summary
User reports 34-36 t/s on an RTX 3090 with Qwen3.8 27B.
Setup is llama.cpp with the IQ4_NL quant and a Q8 KV cache.
The user compares this to 50-60 t/s on Qwen3.6 27B.
on NVIDIA RTX 3090 · llama.cpp