MoAI
by ByungKwanLee
[ECCV 2024] Official PyTorch implementation code for realizing the technical part of Mixture of All Intelligence (MoAI) to improve performance of numerous zero-shot vision language tasks.
AI summary
Vision Language Integrator
Improves performance of vision language tasks by integrating computer vision capabilities into large language models
- stars
- 314
- forks
- 32
- watching
- 11
Similar projects
Found by comparing what the projects do, not just their names.
Vision Language Model
Develops a PyTorch implementation of an enhanced vision language model
Model optimization library
An implementation of Mamba-based traversal of rationale to improve performance of numerous vision language models.
Mixture of Experts Model
A large vision-language model using a mixture-of-experts architecture to improve performance on multi-modal learning tasks
Computer Vision Toolkit
A PyTorch toolbox for supporting research and development of domain adaptation, generalization, and semi-supervised learning methods in computer vision.
Vision-Language Model
A PyTorch implementation of an encoder-free vision-language model that can be fine-tuned for various tasks and modalities
Vision-Language Learning Model
Develops and trains models for vision-language learning with decoupled language pre-training
Image restorer
This project controls vision-language models to restore degraded images in various environments and conditions.
Hallucination mitigation
This project provides an official PyTorch implementation of a method to interpret and edit vision-language representations to mitigate hallucinations in image captions.
Multimodal learner
Develops a multimodal vision-language model to enable machines to understand complex relationships between instructions and images in various tasks.
Multimodal alignment model
Extending pretraining models to handle multiple modalities by aligning language and video representations
Region-of-Interest Training
Training and deploying large language models on computer vision tasks using region-of-interest inputs
Vision-Language Bridge
Pre-trains a multilingual model to bridge vision and language modalities for various downstream applications
mchong6/soat380
Image manipulator
This repository provides a PyTorch implementation of an image manipulation technique using a pretrained StyleGAN model.
Model validator
Analyzing and mitigating object hallucination in large vision-language models to improve their accuracy and reliability.
Localizer
Improves image restoration performance by converting global operations to local ones during inference
