llamaperf

Qwen3.5 13B

on NVIDIA RTX 3060 12GB · llama.cpp

Tone: positiveNVIDIA hardware
Sep 9, 2026
Throughput
12.0 t/s gen
VRAM reported
12 GB

Summary

User reports running llama.cpp's ggml-rpc backend across a heterogeneous cluster pooling RAM and VRAM from an Acer laptop CPU, a Windows RTX 3060 on CUDA, and a Mac Mini on Metal. The primary API server runs on the weakest machine, and the setup uses llama.cpp's built-in benchmark script. The project is source-available under the Commons Clause.