llamaperf

Qwen3.8 125B (6B active) Flash-Next

on Unknown GPU · Strata · 262,144 ctx

Oct 14, 2026
Throughput
100-130 t/s gen
Quant
IQ3_XXS (GGUF)

Summary

User asks whether a Qwen3.8 Flash-Next run seen in another post (IQ3_XXS, 100-130 t/s decode, 2500+ t/s prefill, 262k context, Strata/Hermes on a single 24GB RTX 5090 Mobile with 64GB RAM) could be replicated on Kaggle's free tier. The referenced run is not the user's own measurement; the user only asks about feasibility on Kaggle's 2x Tesla P100 16GB or 2x T4 16GB with about 30GB system RAM. No throughput was measured by the user, so no generation or prefill figure is recorded.