llamaperf

Qwen3.8 27B

on 2× NVIDIA Tesla P100 16GB · llama.cpp · 262,144 ctx

NVIDIA hardware
Nov 10, 2026
Throughput
45.0 t/s gen
Quant
UD-Q5_K_XL (GGUF)
System RAM
44 GB
VRAM reported
16 GB

Use cases

agentictool-uselong-contextmultilingual

Summary

User reports Qwen3.8-27B at about 45 tok/s in English and about 32 tok/s in Polish on 2x Tesla P100 16GB. Setup is llama.cpp with UD-Q5_K_XL at 262k context, row/tensor split with MTP, on an X79 platform (i7-3930K, ~44 GB DDR3) under Proxmox with GPU passthrough. The P100s serve as the main LLM backend for an agent with long prompts and many tool calls; a GTX 1080 handles vision, Whisper, embeddings and image generation. The user asks whether to replace the 1080 with a Titan V or 2080 Ti, and reports a Quadro GP100 was not detected at all on the board.