Calculator GPUs Engines Guides Blog Community MCP Advertise

SponsoredAdvertise on llamaperfllamaperf.comSee the offer →

llamaperf/NVIDIA RTX 5090/report

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 5090

Sep 7, 2026

ShareX Reddit LinkedIn Bluesky

Throughput

44.0 t/s gen

Quant

Q4

Sponsoredtrawlia.coAdvertise here

Give your agent the live web in one call

Ranked results with clean page text, no scraper to babysit. Drop-in for Tavily. 100 credits a month free, no card.

Try Trawlia →

View source ↗

Browse

All GPUs
All models
All engines
Calculator
Compare GPUs
Leaderboard
Best
Best for coding
Macs
Guides
Blog
Trending MCP servers
Local model performance
Discussions

Best of

GPUs for running local LLMs
Mac for running local LLMs
NVIDIA GPUs for local LLMs
GPUs for 70B and larger local LLMs
GPUs for 30B local LLMs
Mac for 70B and larger local LLMs

Popular GPUs

AMD Strix Halo 128GB
NVIDIA RTX 3090
NVIDIA RTX 5090
NVIDIA DGX Spark
NVIDIA RTX Pro 6000 Blackwell
NVIDIA RTX 5060 Ti 16GB
M5 Max 48GB
NVIDIA RTX 3060 12GB

Popular models

Qwen3.8
Qwen3.6
Gemma 4
DeepSeek V4 Flash
Qwen3.5
Qwen3
GLM-5.3
DeepSeek V4.1 Flash

Engines

llama.cpp
vLLM
Strata
MLX
Ollama
oMLX

llamaperf · community-sourced local model performance reports

Submit a report r/llamaperf on Reddit Discord X LinkedIn Advertise About Contact Privacy