Macaw-LLM
Multimodal LLM
A multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation
Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration
2k stars
33 watching
128 forks
Language: Python
last commit: over 1 year ago deep-learninglanguage-modelmachine-learningmulti-modal-learningnatural-language-processingneural-networks
Related projects:
| Repository | Description | Stars |
|---|---|---|
 pleisto/yuren-baichuan-7b | A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks | 73 |
 phellonchen/x-llm | A framework that enables large language models to process and understand multimodal inputs from various sources such as images and speech. | 308 |
 neulab/pangea | An open-source multilingual large language model designed to understand and generate content across diverse languages and cultural contexts | 92 |
 bytedance/lynx-llm | A framework for training GPT4-style language models with multimodal inputs using large datasets and pre-trained models | 231 |
 damo-nlp-mt/polylm | A polyglot large language model designed to address limitations in current LLM research and provide better multilingual instruction-following capability. | 77 |
 alpha-vllm/wemix-llm | An LLaMA-based multimodal language model with various instruction-following and multimodal variants. | 17 |
 yuliang-liu/monkey | An end-to-end image captioning system that uses large multi-modal models and provides tools for training, inference, and demo usage. | 1,849 |
 deeplangai/lingowhale-8b | An open bilingual LLM developed using the LingoWhale model, trained on a large dataset of high-quality middle English text, and fine-tuned for specific tasks such as conversation generation. | 134 |
 multimodal-art-projection/omnibench | Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously. | 15 |
 ailab-cvc/seed | An implementation of a multimodal language model with capabilities for comprehension and generation | 585 |
 mbzuai-oryx/groundinglmm | An end-to-end trained model capable of generating natural language responses integrated with object segmentation masks for interactive visual conversations | 797 |
 luogen1996/lavin | An open-source implementation of a vision-language instructed large language model | 513 |
 csuhan/onellm | A framework for training and fine-tuning multimodal language models on various data types | 601 |
 pku-yuangroup/languagebind | Extending pretraining models to handle multiple modalities by aligning language and video representations | 751 |
 victordibia/llmx | An API that provides a unified interface to multiple large language models for chat fine-tuning | 79 |