llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× NVIDIA A100 80GB · TensorSharp

NVIDIA hardware
Sep 7, 2026
Throughput
56.8 t/s gen · 1019.1 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q2_K_XL (GGUF)
VRAM reported
80 GB

Summary

User benchmarks TensorSharp against llama.cpp on Qwen 3.8 Flash Next, reporting prompt processing and generation speeds for 1 GPU and 2 GPU layer split configurations. The promptTps and generationTps fields capture the 1 GPU pp512 and tg64 values respectively.