llamaperf

MiniMax M3.1 Flash

on 8× NVIDIA A40 48GB · TensorSharp · 65,536 ctx

NVIDIA hardware
Oct 25, 2026
Throughput
22.9 t/s gen · 2567.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-Q4_K_XL (GGUF)
KV cache
F16

Use cases

visiontool-use

Summary

User benchmarks MiniMax-M3.1-Flash at 22.9 tok/s decode at 64K context on 8x NVIDIA A40 GPUs. Setup is TensorSharp with the Unsloth UD-Q4_K_XL GGUF, F16 KV cache, layer splitting, and no speculative decoding. Prefill was 1,699 tok/s at 8K, 2,449 tok/s at 32K and 2,567 tok/s at 64K; time to first token on a 64K prompt was 40.0 s. Results are early, from one host and one quantization, and are compared against llama.cpp (llama-server with flash attention and --no-kv-unified).