Maya L
on NVIDIA RTX 4090 · Maya · 131,072 ctx
Summary
User reports Maya-L at a mean 16.4 tokens/s decode on an RTX 4090 24 GB, with a Ryzen 9 9950X3D and 192 GB DDR5.
Setup is the Maya engine (v1.0.24) with a 156.3 GB GGUF model folder, 131072 context, one GPU, and STRATA_GLM_PCIE_SHARE set to 0.10.
Decode ranged from 15.5 to 18.1 tokens/s over three 256-token answers; prefill was 463 tokens/s at 2048 tokens and 1371 tokens/s at 8192 tokens.