Use cases
coding
Summary
User compares a local Qwen3.8 Flash-Next IQ3_XXS run in Strata against Claude on a coding task, generating a playable first-person motorcycle browser game in HTML.
The local run used an RTX 4070 Super 12GB plus 64GB DDR5, with almost 50GB of RAM in use and only about 7GB left for other tasks. Thinking was capped at 16K tokens because the model otherwise consumed nearly 64K of context.
Decode was around 60-70 tok/s with peaks over 100 tok/s, and the task took 396 s plus 274 s over two requests, about 11 minutes. The user found the result not really playable and concludes local setups are not worthwhile for coding on personal PCs.
Compare this run
Medians of plain runs: one device, one request, no speculative decoding, the whole model in the device's memory. The report above is one setup, so read it beside them and not as one of them.
Qwen3.8 125B · 6B active at 4-bit by hardware
- 129.2 t/s · one run
- 105.5 t/s · 6 runs
- 57.2 t/s · 2 runs
- 55.0 t/s · one run
- 36.7 t/s · one run
- NVIDIA DGX Spark128 GB29.8 t/s · 2 runs
Bars are medians on one scale, 0 to 232.0 tokens/s. Each dot is one run and opens its report. Press ▶ to watch text arrive at a row's speed.
Everything reported on the NVIDIA RTX 4070 Super →Every Qwen3.8 report →Estimate Qwen3.8 on this card →