Qwen3.8 27B
on Intel Panther Lake Integrated Arc B390
Summary
User reports Qwen3.8-27B-NVFP4 at 18+ tok/s decode on an Intel Panther Lake Integrated Arc B390 with 32GiB UMA memory.
Setup uses a custom inference engine with custom NVFP4 kernels targeting Intel Xe3, running on a custom operating system built by the user.
The user notes Ubuntu with llama.cpp achieves less than half the decode performance. They also report ~6.5 tok/s decode with Nemotron3.5-Lightning-30B-A3B-NVFP4 on a Lenovo Yoga 7i (16GB UMA) requiring SSD streaming, with decode physically capped at 17 tok/s due to ~6G/s sequential reads.