llamaperf

Qwen3.8 125B (6B active) Flash-Next

on 2× NVIDIA CMP 170HX 64GB (unlocked) · Strata

Tone: positiveNVIDIA hardware
Oct 9, 2026
Throughput
100.0 t/s gen
Quant
Q4_K_XL (GGUF)
System RAM
96 GB

Use cases

agentictool-use

Summary

User reports Qwen3.8 Flash-Next at 100 tok/s on a CMP 170HX 64GB and one RTX 3090, with system RAM offload. Setup is Strata with Q4_K_XL weights; the run used two GPUs plus system RAM, and the user notes about a quarter of the results came from Strata .38, an eighth from .39, and the rest from .40. Before Strata, the same model ran on three GPUs (CMP 170HX and two RTX 3090s) under Unsloth Studio at 39 tok/s with 84 s average TTFT; the Strata run cut average TTFT to 15.7 s and total LLM time from 5,795m 9s to 1,228m 53s.