Qwen3.5 13B
on NVIDIA RTX 3060 12GB · llama.cpp
Sep 9, 2026
Summary
User reports running llama.cpp's ggml-rpc backend across a heterogeneous cluster pooling RAM and VRAM from an Acer laptop CPU, a Windows RTX 3060 on CUDA, and a Mac Mini on Metal.
The primary API server runs on the weakest machine, and the setup uses llama.cpp's built-in benchmark script.
The project is source-available under the Commons Clause.