llamaperf

Qwen3.8 27B Swift-1.5

on 3× Intel Arc Pro B70 · Strata · 32,768 ctx

Tone: positiveIntel hardware
Oct 8, 2026
Throughput
40-45 t/s gen
Quant
IQ4_XS (GGUF)
System RAM
64 GB
VRAM reported
88 GB

Summary

User reports a Strata fork (Strata Void) with task-parallel requests running Swift 1.5 Qwen3.8 Flash-Next at around 40-45 tok/s single-stream on three Intel Arc GPUs (B70 32GB, B65 32GB, B60 24GB, 88GB total VRAM). Setup is Strata with IQ4_XS weights and a 32K context window; all expert weights are in VRAM with no RAM spilling. The fork splits complex requests into parallel subtasks and synthesizes the results: 10 complex tasks took a 181s median as a normal request, 68s median with four parallel subtasks plus synthesis, and 78s median in AUTO mode. The user notes this does not raise single-stream token generation speed and uses more total compute.