Qwen3.8 27B
on Unknown GPU · llama.cpp · 16,384 ctx
Use cases
coding
Summary
User reports Qwen3.8 27B at about 2.5 tok/s on a OnePlus 13 phone with 24 GB RAM.
Setup is llama.cpp with Q4_K_M at 16K context, using around 21.2 GB of memory; the LLM and TTS run on the NPU.
User also runs Qwen3.5 9B at around 5 tok/s using about 16.1 GB RAM with always-on ASR and TTS. Heat is the main problem, so inference pauses when the phone gets too hot, and lower-power modes reduce TPS.