llamaperf

Unknown family

on NVIDIA RTX 5070 · llama.cpp

Tone: negativeNVIDIA hardware
Sep 23, 2026
Throughput
1800.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.

Summary

User reports that after AUR llama.cpp-cuda package deletion, binary packages (ggml-cuda and llama.cpp) are ~10% speed, with model loaded to GPU but processing on CPU. Custom build achieves 1800 t/s prefill vs 150 t/s. GPU is RTX 5070.