Parrot
by AIDC-AI
🎉 The code repository for "Parrot: Multilingual Visual Instruction Tuning" in PyTorch.
AI summary
Visual Instruction Toolkit
A method and toolkit for fine-tuning large language models to perform visual instruction tasks in multiple languages.
- stars
- 34
- forks
- 1
- watching
- 4
Similar projects
Found by comparing what the projects do, not just their names.
Multimodal aligner
An MLLM architecture designed to align visual and textual embeddings through structural alignment
Computer Vision Toolkit
A PyTorch toolbox for supporting research and development of domain adaptation, generalization, and semi-supervised learning methods in computer vision.
Visual Instruction Model
A project that extends large language models by integrating an additional region-level vision encoder to improve visual instruction tuning.
Language model toolkit
A guide to using pre-trained large language models in source code analysis and generation
Visual Instruction Tuning
An open-source project that enhances visual instruction tuning for text-rich image understanding by integrating GPT-4 models with multimodal datasets.
Vision-Language Model
A multimodal AI model that enables real-world vision-language understanding applications
AI dataset toolkit
A PyTorch-based toolkit for creating customized multimedia datasets and handling heterogeneous data for training AI models.
nvlabs/prismer1.3K
Vision-Language Model
A deep learning framework for training multi-modal models with vision and language capabilities.
VLIT model toolkit
A comprehensive dataset and evaluation framework for Vision-Language Instruction Tuning models
Multimodal LLM
An implementation of a multimodal language model with capabilities for comprehension and generation
Instruction dataset generator
Autonomously generates high-quality image-text instruction fine-tuning datasets
Instruction generator
Creating synthetic visual reasoning instructions to improve the performance of large language models on image-related tasks
Deep learning toolkit
A Python framework for building deep learning models with optimized encoding layers and batch normalization.
Feature visualization toolkit
Toolkit for visualizing neural network behavior in PyTorch
Visual Instruction Tuning
A dataset and model designed to scale visual instruction tuning using language-only GPT-4 models.
