llamaperf

Qwen3.8 125B (6B active) Flash-Next

on NVIDIA RTX 5070 Ti · Strata · 256,000 ctx

Tone: mixedNVIDIA hardware
Nov 10, 2026
Throughput
99.2 t/s gen · 839.0 tokens/s prompt processing (prefill)Prompt processing is how fast the input is read, not how long you wait for the first word. How to measure time to first token.
Quant
iq3s
System RAM
128 GB

Use cases

codingagentic

Summary

User compares Strata and Basalt running Qwen3.8-Flash-Next iq3s at 256k context on an RTX 5070 Ti with 128GB DDR4 and a 12900k, using opencode as the harness. Strata averaged 99.2 t/s generation and 839 t/s prefill over 11.1M tokens, with DFlash 2 and vision on, using 15.3GB VRAM and 69.2GB RAM. Basalt averaged 100 to 118 t/s and peaked at 145 t/s, with prefill peaking at 4200 t/s, using 15.8GB VRAM and 52.7GB RAM. User says Strata stalled between phases and failed to compact or finish the work, while Basalt ran smoothly and completed the project with fewer errors and less RAM. They plan to test NVFP4 and Swift next.