llamaperf

Ornith 1.5-9B / Vulkan RADV native PP512/TG128

on AMD Strix Halo 128GB · llama.cpp / Vulkan RADV / build unknown

AMD hardware
Oct 13, 2026
Throughput
23.8 t/s gen · 830.8 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q8_0 (GGUF)
Flash Attention
on
System RAM
128 GB

Summary

User reports Ornith-1.5-9B at 23.8 t/s generation and 830.8 t/s prompt processing on an AMD Strix Halo 128GB system with a single Radeon 8060S iGPU. Setup is llama.cpp via RADV with official Q8_0, full offload, batch 2048 and flash attention, using llama-bench pp512 and tg128. The 23.75 t/s and 830.81 t/s figures are separate 512-token prompt and 128-token generation microbenchmarks, not one end-to-end request; repetition count, context allocation and cache type are unpublished.