VITA
by VITA-MLLM
✨✨VITA: Towards Open-Source Interactive Omni Multimodal LLM
AI summary
Multimodal processor
A large multimodal language model designed to process and analyze video, image, text, and audio inputs in real-time.
- stars
- 1K
- forks
- 58
- watching
- 40
Similar projects
Found by comparing what the projects do, not just their names.
openbmb/viscpm1.1K
Multimodal Models
A family of large multimodal models supporting multimodal conversational capabilities and text-to-image generation in multiple languages
Image processor
An all-in-one demo for interactive image processing and generation
Multimodal benchmarking
Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously.
Multimodal LLM
A multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation
Multimodal LLM
An open-source multilingual large language model designed to understand and generate content across diverse languages and cultural contexts
Multimodal LLM
An implementation of a multimodal language model with capabilities for comprehension and generation
Multimodal LLM
An LLaMA-based multimodal language model with various instruction-following and multimodal variants.
VQA model
A multimodal LLM designed to handle text-rich visual questions
Multilingual LLM
A polyglot large language model designed to address limitations in current LLM research and provide better multilingual instruction-following capability.
Multimodal Model Builder
A framework to build versatile Multimodal Large Language Models with synergistic comprehension and creation capabilities
Multimodal LLM
A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks
Image captioner
An end-to-end image captioning system that uses large multi-modal models and provides tools for training, inference, and demo usage.
Multimodal model developer
Develops large multimodal models for high-resolution understanding and analysis of text, images, and other data types.
Multi-view modeler
A software framework for multi-view latent variable modeling with domain-informed structured sparsity
Multimodal learner
Develops a multimodal vision-language model to enable machines to understand complex relationships between instructions and images in various tasks.
