llamaperf

NVIDIA GTX 1080 Ti

NVIDIA · 11GB · 5 reports

Is this your card?

On the NVIDIA GTX 1080 Ti, Llama 2 7B at 4-bit, the model most run on it, generates a median of 62.0 tokens per second from one plain run (community reports, as of 22 Nov 2026).

As of 22 Nov 2026, the models most run on the NVIDIA GTX 1080 Ti, each one size at one quant level, with the median generation speed of its plain runs (one device, one request, no speculative decoding):

  • Llama 2 7B4-bit · PP 1084.0 t/s, one run
    62.0 t/s · one run

Bars are medians on one scale, 0 to 62.0 tokens/s. Press ▶ to watch text arrive at a row's speed.

Engines people use on it: llama.cpp 3 (reports) · text-generation-webui 1 (reports)

Run models on your NVIDIA GTX 1080 Ti? Add your numbers.

Your coding agent can run a speed test on your machine and send it here with a free account. Or paste a result you've already posted.

Reported performance on the NVIDIA GTX 1080 Ti

These reports mix GPU counts and memory setups, so a model listed here may have needed extra cards or CPU offloading. The calculator estimates which models fit in 11 GB of VRAM. Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.

Speeds are as each source reported them. GPU count, offloading and concurrent requests change them, and prompt-processing speed is input throughput, not time to first token. Check the full setup before comparing two reports.

Llama 3.1 8B

NVIDIA GTX 1080 Ti · text-generation-webui

Tone: positiveNVIDIA hardware
generation:
1.0 tokens/s
rp

User recounts their AI tooling history, starting with Ollama, LM Studio, Msty and text-generation-webui on a mini PC with an i5 6400T and 24GB DDR4 using integrated graphics, where Llama 3.1 8B generated about 1 tok/s. They later moved to a Xeon E3-1270 V2 with 32GB DDR3 and a GTX 1080 Ti, then SillyTavern with KoboldCpp, Llamafile and finally llama.cpp. The 1 tok/s figure is from the earlier integrated-graphics mini PC, not the 1080 Ti; the user says they enjoyed it despite the limits and that roleplay started there.

Nov 17, 2026
Tone: mixedNVIDIA hardware
generation:
7-10 tokens/s
quant:
Q4_K_M (GGUF)
codingagentic

User asks which model to use as a coding builder agent on a GTX 1080 Ti 11GB with 32GB RAM, running llama.cpp with the Vulkan backend. They report Qwen3.6 35B A3B UD Q4_K_M at about 7 to 10 t/s on a few small tasks, and Qwen3.5-9B UD Q4_K_XL with MTP at about 25 to 30 t/s but not usable as a builder agent. They also tried Sharp Spark X2.5 4B Q6_K_XL, which overthinks, and Sharp Spark X2.6 4B Q6_K_XL, which is fine for simple tasks but not real work. They want 100k to 128k context and note CUDA is unstable on the 1080 Ti.

Nov 7, 2026
NVIDIA hardware
generation:
62.0 tokens/s
prompt processing (prefill):
1084.0 tokens/s
quant:
Q4_0 (GGUF)

User benchmarks Llama-2 7B at 62 t/s generation and 1084 t/s prompt processing on an NVIDIA GTX 1080 Ti 11GB. Setup is the CUDA build of llama.cpp with Q4_0 GGUF weights, run via llama-bench with -ngl 100. Figures are pp512 and tg128, a plain single-stream run with no speculative decoding.

Oct 20, 2026
Tone: positiveNVIDIA hardware
generation:
52.0 tokens/s
prompt processing (prefill):
340.9 tokens/s
quant:
Q6_K_XL (GGUF)

User reports Gemma 4 26B-A4B at 52.03 t/s generation and 340.86 t/s prompt processing on a dual-GPU setup of GTX 1080 Ti and Radeon MI50 16GB, totaling 27GB VRAM. Setup is llama.cpp Vulkan pre-built binary build 851cb34f2 (11055) with the UD-Q6_K_XL GGUF, flash attention on, and 99 GPU layers offloaded. Single-GPU GTX 1080 Ti runs of the same model reached 11.76 t/s generation and 162.12 t/s prompt processing. The user also benchmarked Qwen3.6-35B-A3B MXFP4 MoE, Nemotron 31B-A3.5B Q5_K_M, Qwen3.8 27B Q6_K, and medgemma 27B Q6_K_XL, noting dense models benefited most from the second GPU.

Sep 19, 2026
NVIDIA hardware
generation:
19.7 tokens/s
prompt processing (prefill):
332.6 tokens/s
quant:
MXFP4 (GGUF)

User benchmarks Qwen3.6 35B-A3B at 19.7 t/s generation and 332.57 t/s prompt processing on a mixed GTX 1080 Ti and Radeon VII Vulkan setup. Setup is llama.cpp Vulkan build b29c606e2 with the MXFP4 MoE GGUF and Flash Attention enabled, across two GPUs. User also reports results for twelve other models including llama 7B, bailingmoe2 16B-A1B, gpt-oss 20B, Gemma 4 26B-A4B, Qwen3.5 27B, Qwen3-Coder 30B-A3B, granite 4.0, and Phi-3.5-MoE.

Sep 18, 2026

Get a weekly email of new NVIDIA GTX 1080 Ti reports and newly released models that fit it.

Email me new reports

Reported configurations

Individual observations from this page, not expected speeds or a ranking. Select a model to open its report, with the source and offloading conditions. Reported context may be a limit rather than actual input length.

Model / hardwareQuant / engineReported contextGeneration
Llama 3.1 8B
NVIDIA GTX 1080 Ti
Not reported
text-generation-webui
Not reported1.0 tokens/s
Llama 2 7B
NVIDIA GTX 1080 Ti
Q4_0
llama.cpp
Not reported62.0 tokens/s
Gemma 4 26B (4B active)
2× NVIDIA GTX 1080 Ti
Q6_K_XL
llama.cpp
Not reported52.0 tokens/s
Qwen3.6 35B (3B active)
2× NVIDIA GTX 1080 Ti
MXFP4
llama.cpp
Not reported19.7 tokens/s

Frequently asked

How fast is the NVIDIA GTX 1080 Ti for local LLMs?

On the NVIDIA GTX 1080 Ti, Llama 2 7B at 4-bit, the model most run on it, generates a median of 62.0 tokens per second from one plain run (community reports, as of 22 Nov 2026).