Modality-Integration-Rate

Modality Integration Rate

Provides an implementation of modality integration rate for vision-language models in PyTorch

The official code of the paper "Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration Rate".

GitHub

89 stars
3 watching
3 forks
Language: Python
last commit: about 2 months ago
chatbotgpt-4olarge-multimodal-modelsllamallavamultimodalvision-language-learningvision-language-model