Qwen3.8 27B
2× AMD RX 9060 XT 16GB · llama.cpp · 32,768 ctx
- generation:
- 15-18 tokens/s
- quant:
- Q4 (GGUF)
User reports running Qwen3.8 27B Q4 via llama.cpp RPC across two machines, an RX 9060 XT 16GB and an RTX 5060 Ti 16GB, at 15-18 t/s with a 32k context. Setup is llama.cpp RPC with Q4 weights and a 32k context, split over the two 16GB cards. The user asks whether Qwen3.8 Flash-Next can be run by adding CPU-only RPC workers on the same machines to offload to their 32GB and 64GB of system RAM.