llamaperf

Llama 2 7B

on NVIDIA GTX 1080 Ti · llama.cpp

NVIDIA hardware
Oct 20, 2026
Throughput
62.0 t/s gen · 1084.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_0 (GGUF)
VRAM reported
11 GB

Summary

User benchmarks Llama-2 7B at 62 t/s generation and 1084 t/s prompt processing on an NVIDIA GTX 1080 Ti 11GB. Setup is the CUDA build of llama.cpp with Q4_0 GGUF weights, run via llama-bench with -ngl 100. Figures are pp512 and tg128, a plain single-stream run with no speculative decoding.