PandaGPT

Instruction-follower

A foundation model capable of instruction-following data across multiple modalities without explicit supervision.

[TLLM'23] PandaGPT: One Model To Instruction-Follow Them All

GitHub

772 stars
11 watching
60 forks
Language: Python
last commit: over 3 years ago

Related projects:

RepositoryDescriptionStars
mbzuai-nlp/bactrian-xA collection of multilingual language models trained on a dataset of instructions and responses in various languages.94
opendatalab/vigcAutonomously generates high-quality image-text instruction fine-tuning datasets91
dcdmllm/cheetahA large language model designed to understand and generate instructions with accompanying visual content360
xuefuzhao/instructionwildCreating a large-scale user-based instruction dataset for natural language processing research and development455
autodistill/autodistillAutomatically trains models from large foundation models to perform specific tasks with minimal human intervention.2,022
jianbo-lab/l2xA Python framework for learning to interpret models using information-theoretic methods123
gwenlegate/guidinglastlayerflpretrainInvestigates transfer learning in federated learning by guiding the last layer with pre-trained models7
shawn-ieitsystems/yuan-1.0Large-scale language model with improved performance on NLP tasks through distributed training and efficient data processing591
ymcui/pertDevelops a pre-trained language model to learn semantic knowledge from permuted text without mask labels356
royson/fedl2pThis project enables personalized learning models by collaborating on learning the best strategy for each client19
sihengli99/textbindEnables larger language models to generate multi-turn multimodal instruction-response conversations from image-caption pairs with minimal annotations.47
allenai/natural-instructionsCreating a large collection of tasks and their natural language definitions/instructions to support the development of NLP models with generalization capabilities963
yuetan031/fedprotoAn implementation of federated learning with prototype-based methods across heterogeneous clients134
brightmart/xlnet_zhTrains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks230
vt-nlp/multiinstructA multimodal benchmark dataset designed to evaluate the performance of vision-language foundation models through instruction tuning.134