llamaperf

StepFun 3.7 198B (11B active) Flash

on M5 Max 128GB · llama.cpp · 65,536 ctx

Apple hardware
Aug 28, 2026
Throughput
33.9 t/s gen
Quant
Q4_K_S (GGUF)
System RAM
128 GB
VRAM reported
128 GB

Summary

User benchmarks prompt processing at 65,536 context, with throughput falling from 62.80 t/s at 128 context to 33.92 t/s at 65,536. Memory peaked at ~120+ GB, and the system stayed sluggish but usable.