Qwen3.8 27B
on 2× NVIDIA Tesla P100 16GB · llama.cpp · 262,144 ctx
Use cases
agentictool-uselong-contextmultilingual
Summary
User reports Qwen3.8-27B at about 45 tok/s in English and about 32 tok/s in Polish on 2x Tesla P100 16GB.
Setup is llama.cpp with UD-Q5_K_XL at 262k context, row/tensor split with MTP, on an X79 platform (i7-3930K, ~44 GB DDR3) under Proxmox with GPU passthrough.
The P100s serve as the main LLM backend for an agent with long prompts and many tool calls; a GTX 1080 handles vision, Whisper, embeddings and image generation. The user asks whether to replace the 1080 with a Titan V or 2080 Ti, and reports a Quadro GP100 was not detected at all on the board.