Llama2 7B
on 2× heterogeneous GPUs total: Radeon 8060S + NVIDIA RTX 5070 Ti 16GB · llama.cpp / Vulkan (build unreported)
Summary
User reports Llama2 7B at 130.2 t/s generation and 5790.9 t/s prompt processing on a Radeon 8060S plus an RTX 5070 Ti over OCuLink.
Setup is llama-bench with Q4_0, -ngl 99, -fa 1, -n 128 and -p 512, split 9/1 between the RTX 5070 Ti and the Radeon 8060S.
The 9/1 split is the first interior configuration, not the fastest single-device endpoint; the 10/0 endpoint reached 168.91 t/s generation and 7461.22 t/s prompt processing.