EAGLE
by NVlabs
EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders
AI summary
Multimodal model builder
Develops high-resolution multimodal LLMs by combining vision encoders and various input resolutions
- stars
- 549
- forks
- 45
- watching
- 31
Similar projects
Found by comparing what the projects do, not just their names.
Multimodal LLM
An implementation of a multimodal language model with capabilities for comprehension and generation
Vision-Language Model
A deep learning framework for training multi-modal models with vision and language capabilities.
Image processor
An all-in-one demo for interactive image processing and generation
Vision-Language Model
A PyTorch implementation of an encoder-free vision-language model that can be fine-tuned for various tasks and modalities
Multimodal Model Builder
A framework to build versatile Multimodal Large Language Models with synergistic comprehension and creation capabilities
Multimodal LLM
A multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation
Generative model framework
This project provides a set of tools and techniques to design and improve diffusion-based generative models.
LLM
An open-source implementation of a vision-language instructed large language model
Multimodal benchmarking
Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously.
Model arena
An evaluation platform for comparing multi-modality models on visual question-answering tasks
VQA model
A multimodal LLM designed to handle text-rich visual questions
Multimodal LLM framework
A framework for training GPT4-style language models with multimodal inputs using large datasets and pre-trained models
Multimodal Chatbot
Trains a multimodal chatbot that combines visual and language instructions to generate responses
Multimodal model developer
Develops large multimodal models for high-resolution understanding and analysis of text, images, and other data types.
Multimodal LLM
An open-source multilingual large language model designed to understand and generate content across diverse languages and cultural contexts
