Qwen3.8 27B
on NVIDIA RTX 5070 · llama.cpp
Summary
User reports Qwen 3.8 27B at about 4 tokens/s on an RTX 5070 in a laptop with a Core Ultra 9 275HX and 32GB DDR5.
Setup is llama.cpp with Q4_K_M, launched with -ngl auto; anything else crashes.
The run uses 100% of system RAM, about 25% of the iGPU and 0-3% of the RTX 5070, so the model is not running on the discrete GPU.