llamaperf

Qwen3.8 125B (6B active) Flash-Next

on Unknown GPU · llama.cpp · 220,000 ctx

Tone: mixed
Oct 8, 2026
Throughput
30-40 t/s gen · 530.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
UD-IQ3_XXS (GGUF)
KV cache
Q8_0

Use cases

codingagentic

Summary

User reports running Qwen3.8-Flash-Next-UD-IQ3_XXS at Q8_0 KV-cache with llama.cpp, getting 30-40 t/s generation and 530 t/s prefill at 220,000 context. Setup is llama.cpp with UD-IQ3_XXS quant and Q8_0 KV cache, limited by VRAM. User stopped using Strata after 12 hours of coding due to reliability concerns, citing hallucinations and coding errors, but notes Strata greatly increased prefill speed and is a worthwhile project.