llamaperf

Qwen3.8 27B

on 2× NVIDIA RTX 5070 Ti · llama.cpp

NVIDIA hardware
Sep 6, 2026
Throughput
60.0 t/s gen · 1500.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ4_XS (GGUF)
VRAM reported
16 GB

Summary

User reports 60 t/s decode and 1500 t/s prefill with Qwen3.8-27B-IQ4-XS-MTP across an RTX 5070 Ti and an RTX 5060 Ti. Setup uses tensor parallelism. User is considering adding a 3090 FE for more VRAM but is concerned about mixing Ampere with Blackwell.