Qwen3-VL 8B
on NVIDIA RTX 5070 Ti · stable-diffusion.cpp
Use cases
vision
Summary
User reports the Qwen3-VL 8B text encoder generating at about 127 tokens/s on an RTX 5070 Ti in Kokon 0.10, the same rate llama.cpp gives.
Setup is the app's own fork of stable-diffusion.cpp with text generation added to the already-loaded text encoder, so no second model is downloaded or held in memory.
The optional Prompt+ feature adds about 2 s per image on the RTX 5070 Ti and about 13 s on an M2 Pro, and works on 8 GB cards. The image side is upstream code and produces bit-identical images.