llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA Tesla P100 16GB · llama.cpp · 80,000 ctx

Tone: mixedNVIDIA hardware
Oct 12, 2026
Throughput
5.8 t/s gen · 56.1 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ3_XXS (GGUF)
System RAM
64 GB
VRAM reported
16 GB

Use cases

codingagentictool-use

Summary

User reports Qwen3.8-Flash-Next at 5.84 t/s generation and 56.10 t/s prompt processing on an Nvidia P100 16GB. Setup is llama.cpp with IQ3_XXS quant and 80K context, running on an HP Z440 workstation with Intel Xeon E5-1650 v3 and 64GB RAM. The model is a 125B MoE with 6B active parameters, partially offloaded to CPU. User notes it is slow but works for non-time-critical tasks like email sorting and calendar management.