Qwen-VL is Alibaba Cloud’s vision-language large model family, designed to integrate visual and linguistic modalities. It accepts image inputs (with optional bounding boxes) and text, and produces text (and sometimes bounding boxes) as output. The model variants (VL-Plus, VL-Max, etc.) have been upgraded for better visual reasoning, text recognition from images, fine-grained understanding, and support for high image resolutions / extreme aspect ratios. Qwen-VL supports multilingual inputs and conversation (e.g. Chinese, English), and is aimed at tasks like image captioning, question answering on images (VQA, DocVQA), grounding (detecting objects or regions from textual queries), etc.
Features
- Strong performance on many vision-language tasks: image captioning, VQA, DocVQA, grounding, text recognition in images etc.
- Very high resolution image input support (up to millions of pixels), and handling extreme aspect ratios for detailed visual content
- Multilingual: supports Chinese, English, and other languages in image text / conversation tasks
- Variants (VL-Plus, VL-Max) offer increasing capability: VL-Max is more capable in instruction following, visual reasoning, better model of cognition etc.
- Fine-tuning and quantization options (e.g. Int4 modes, Q-LoRA) for lower resource usage
- Supports multi-image interleaved conversations: comparing multiple images, storytelling, multi-image inputs in dialogues
License
Apache License V2.0Follow Qwen-VL
Other Useful Business Software
Build Securely on Azure with Proven Frameworks
Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Qwen-VL!