Unknown family

User benchmarks llama 7B Q4_0 at 126.09 t/s generation and 3785.07 t/s prompt processing on a single AMD Radeon RX 7900 XTX. Setup is llama.cpp with the ROCm backend, Q4_0 quant, all layers offloaded (-ngl 99), and Flash Attention enabled. A second RX 7900 XTX gives 138.57 t/s generation and 3800.57 t/s prompt processing on the same model. Dual-GPU 7B is slower (94.13 t/s generation) as the model is too small to benefit. Llama 3.1 70B Q4_K_M across both GPUs reaches 13.37 t/s generation and 341.41 t/s prompt processing with Flash Attention.