llamaperf

Qwen3.8 125B (6B active) Swift-1.5

on AMD Strix Halo 128GB · halogen-flash-server · 128,000 ctx

Tone: positiveAMD hardware
Oct 9, 2026
Throughput
36.0 t/s gen · 1634.0 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
IQ4_XS (GGUF)
System RAM
128 GB

Use cases

codingagentictool-uselong-context

Summary

User benchmarks Swift-1.5 Qwen3.8-Flash-Next IQ4_XS on a Strix Halo 128GB (Ryzen AI Max+ 395, Radeon 8060S) at 36.0 t/s decode for prose, 43.2 t/s code and 40.9 t/s reasoning, with 1,634 t/s prefill at 52k context. Setup is halogen-flash-server 0.16.2 with IQ4_XS weights at 128k context, single stream, temperature 1.0 and reasoning_effort medium. The same engine with base Flash-Next decoded 41.7/51.3/51.6 t/s and prefilled 1,655 t/s at 52k, while the best llama.cpp Vulkan config (Swift Flash-Next IQ3_XXS with MTP n=3) reached 28.8/44.0/46.5 t/s decode and 275 t/s prefill at 52k. Swift-1.5 finished agentic tasks in 40.4 s each versus 53.3 s for base Flash-Next, scoring 36/36 agentic tasks and 56/58 eval items.