Qwen2.5 7B Coder

User benchmarks Qwen2.5-Coder-7B-Instruct Q4_K_M on an RTX 4090, comparing llama.cpp at 158.90 tok/s decode against apr 0.64.0 at 103.26 tok/s. Setup is llama.cpp build 39173bcac and apr 0.64.0 CUDA with the same GGUF, profile medium, 15s warmup, 3 x 30s runs, 10s cooldown, concurrency 1, streaming. Decode is 0.650x of llama.cpp, with ITL p50 6.29 ms vs 9.68 ms and throughput 1.24 vs 0.77 req/s. The user notes apr's figure is 2.6x the ~40 tok/s 7B reference and that an earlier 11.8 tok/s report was an end-to-end rate including ~9.7s model load.