Qwen3.5 4B

User benchmarks Qwen3.5 4B Q8_0 at 107 t/s generation and 4,445 t/s prompt processing on a Tesla V100 32GB. Setup is llama.cpp (PrismML fork 3ae4f51, CUDA 12.9) with flash attention on, -ngl 99, tested at 0, 16K and 32K context; generation drops to 93 t/s at 32K. An RTX 4070 control card reaches 91 t/s generation and 5,860 t/s prompt processing on the same model. The V100 draws 154 W while generating (0.69 tokens/joule) against the 4070's 173 W (0.53 tokens/joule).