Multi-Modality-Arena
by OpenGVLab
Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing images as inputs. Supports MiniGPT-4, LLaMA-Adapter V2, LLaVA, BLIP-2, and many more!
AI summary
Model arena
An evaluation platform for comparing multi-modality models on visual question-answering tasks
- stars
- 478
- forks
- 36
- watching
- 6
Similar projects
Found by comparing what the projects do, not just their names.
Multimodal Chatbot
Trains a multimodal chatbot that combines visual and language instructions to generate responses
AI agent framework
A framework and benchmark for training and evaluating multi-modal large language models, enabling the development of AI agents capable of seamless interaction between humans and machines.
Multimodal conversational model
An end-to-end trained model capable of generating natural language responses integrated with object segmentation masks for interactive visual conversations
openbmb/viscpm1.1K
Multimodal Models
A family of large multimodal models supporting multimodal conversational capabilities and text-to-image generation in multiple languages
Video conversational model
A video conversation model that generates meaningful conversations about videos using large vision and language models
nvlabs/eagle549
Multimodal model builder
Develops high-resolution multimodal LLMs by combining vision encoders and various input resolutions
Multimodal model
A large multimodal model for visual question answering, trained on a dataset of 2.1B image-text pairs and 8.2M instruction sequences.
Multimodal benchmarking
Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously.
Multi-modal model evaluation suite
A collection of benchmarks to evaluate the multi-modal understanding capability of large vision language models.
tsb0601/mmvp296
Visual model evaluation
An evaluation framework for multimodal language models' visual capabilities using image and question benchmarks.
VQA model
A multimodal LLM designed to handle text-rich visual questions
Multimodal LLM
An implementation of a multimodal language model with capabilities for comprehension and generation
Multimodal model trainer
An implementation of a multimodal LLM training paradigm to enhance truthfulness and ethics in language models
Visual Prompt Model
A system designed to enable large multimodal models to understand arbitrary visual prompts
Multi-view modeler
A software framework for multi-view latent variable modeling with domain-informed structured sparsity
