llamaperf
Oct 11, 2026
System RAM
128 GB

Use cases

codingagentic

Summary

User reports running Qwen3.8 Flash-Next on a Strix Halo 128GB at 1600-1800 t/s prompt processing and 60 t/s generation for agentic work. The source discusses Halogen and Gufo with Q4_K_XL but does not unambiguously attribute this Flash-Next speed range to one engine/quant combination; structured engine and quantization are therefore unspecified. The 128GB is unified memory on the Framework Desktop, not additional discrete VRAM. A separate single CMP 170HX 64GB (unlocked from 8GB) runs two concurrent Qwen3.8 27B sessions with 200k bf16 context each, using DFlash 2 speculative decoding. Aggregate performance at low context is 2000 t/s prompt and 150-300 t/s generation. A 4-hour session with 7.2M tokens in and 1.1M tokens out averaged 1747 t/s prompt and 100 t/s generation aggregate across the two 27B sessions. The CMP 170HX sits on a USB4 eGPU dock limited to PCIe 2x4. The user dropped cloud usage entirely with this setup, which draws about 400W fully loaded and cost around $3000 total. Hardware attribution corrected: the Flash-Next figures above belong to the Strix Halo. Two concurrent 27B sessions on the separate CMP 170HX are not two GPUs; the author cancelled the second-card purchase. The CMP figures remain a separate workload and are not assigned to this Flash-Next report.