llamaperf

Qwen3.8 27B

on AMD RX 7900 XTX · Ollama · 65,536 ctx

AMD hardware
Sep 7, 2026
Throughput
34.4 t/s gen · 215.8 tokens/s prompt processing (prefill)Prompt processing measures input prefill speed; it does not tell you the time to first token.
Quant
Q4_K_M (GGUF)
KV cache
Q8
System RAM
32 GB
VRAM reported
24 GB

Summary

User compares Ollama/ROCm and llama.cpp/Vulkan on an RX 7900 XTX. Ollama reaches 215.8 t/s prompt processing and 34.4 t/s generation at 64K context. llama.cpp/Vulkan reaches 192.0 t/s prompt and 35.8 t/s generation at 64K context, and 230.5 t/s prompt and 36.0 t/s generation at 8K context. The user notes Vulkan is only about 4% faster for generation, while Ollama is better at prompt processing at 64K. The user wonders whether higher reported speeds of 60-100 t/s come from MTP/speculative decoding or other optimizations.