llamaperf

Qwen3.8 125B (6B active) Flash-Next

on Unknown GPU

Tone: positive
Sep 7, 2026
Throughput
3.5 t/s gen

Summary

User reports running a model on a 12 GB mid-range Android phone with optimizations and low quantization on the dense part. The model size is given as 80 GB, likely the total including quantized weights.