Qwen3.5 9B

User reports 62 t/s generation. Source evidence (verbatim): Source: https://digtvbg.com/blog/llama-server-vulkan-rdna4-vllm-rocm-benchmark/ # Local LLM Inference on AMD RX 9070 XT: Vulkan vs ROCm Benchmarks on RDNA4 Hardware: AMD RX 9070 XT with 16GB VRAM on CachyOS. Model: Qwen3.5-9B-UD-Q6_K_XL (about 6.5 bits per weight). llama-server from llama.cpp built against Vulkan with --n-gpu-layers 999 -c 65536 --batch-size 2048 --ubatch-size 2048 --parallel 1: 62 tokens/second. vLLM on ROCm 7.2: 48 tokens/second. Same prompt, max tokens, temperature 0 and seed 42 for both; 10 measured runs per backend after 2 warmup runs. No speculative decoding is configured.