Llama 3.1 8B
on AMD RX 7800 XT 16GB · Ollama
Summary
User reports Llama 3.1 8B at 1.5 t/s on an AMD RX 7800 XT under Ollama, compared with 65 t/s in LM Studio on the same machine.
Setup is Ollama 0.4.7 on Windows with the Q4_K_M quant, Adrenalin Edition 24.10.1 drivers.
The user asks whether the gap is their setup or an Ollama limitation.