Calculator GPUs Engines Guides

llamaperf/Arcle V1

Arcle V1

0 reports

No reports yet for Arcle V1.

Recommended hardware

Best GPUs for running local LLMs

Best GPUs for running local LLMs — ranked from real community reports of tokens-per-second across llama.cpp, vLLM, MLX, and exllama.

Browse

All GPUs
All models
All engines
Calculator
Compare GPUs
Leaderboard
Best
Guides
Local model performance
Discussions

Best of

GPUs for running local LLMs
Mac for running local LLMs
NVIDIA GPUs for local LLMs
GPUs for 70B local LLMs
GPUs for 30B local LLMs
Mac for 70B local LLMs

Popular GPUs

RTX 4050 6GB
CMP 170HX
M1 8GB
M2 8GB
RX 5700 XT 8GB
NVIDIA P102-100
RTX 2080 Ti
D700 12GB

Popular models

Qwen3.8
Qwen3.6
DeepSeek V4 Flash
Gemma 4
Muse
Qwen3.5
DeepSeek V4
GLM-5.2

Engines

llama.cpp
vLLM
Ollama
MLX
LM Studio
ExLlamaV3

llamaperf · community-sourced local model performance reports

Submit a report Contact