Use cases
visionsummarization
Summary
User reports a model based on Qwen3.5-4B, trained on 8xH100 for 3 days.
It supports Safetensors, GGUF and MLX weights, requires as little as 4GB VRAM, and is available in GPTQ, W8A8, FP8, Q4 and Q6 quantizations.
It has been tested with vLLM, SGLang and llama.cpp.