Raon-1 29B (4B active) mini-preview

User benchmarks a hipfire-native MQ4 build of KRAFTON's Raon-1-mini-preview (28.8B/4.3B MoE) on a 20 GB RX 7900 XT with ROCm 7.1, getting 12.6 t/s prefill at pp512 and 4.6 t/s decode. Setup is hipfire with an MQ4 quant; the numbers are single runs. The same model under llama.cpp with the official Q4_K_M GGUF reached 2,055 t/s pp512, 1,477 t/s pp8192 and 47.4 t/s decode, roughly 200x faster prefill and 10x faster decode. The user attributes the gap to hipfire handling recurrent state token by token with no batched prefill kernel. The MQ4 file is 1.29 GB smaller than the official GGUF and agrees with it at mean KL 2.06 and 51.6% top-1; 65K context is the ceiling on 20 GB, and stock hipfire v0.4.2.1 needs a patch to serve this model.