MiniMax M3.1 Flash
on 8× NVIDIA A40 48GB · TensorSharp · 65,536 ctx
Oct 25, 2026
Use cases
visiontool-use
Summary
User benchmarks MiniMax-M3.1-Flash at 22.9 tok/s decode at 64K context on 8x NVIDIA A40 GPUs.
Setup is TensorSharp with the Unsloth UD-Q4_K_XL GGUF, F16 KV cache, layer splitting, and no speculative decoding. Prefill was 1,699 tok/s at 8K, 2,449 tok/s at 32K and 2,567 tok/s at 64K; time to first token on a 64K prompt was 40.0 s.
Results are early, from one host and one quantization, and are compared against llama.cpp (llama-server with flash attention and --no-kv-unified).