SEED
Multimodal LLM
An implementation of a multimodal language model with capabilities for comprehension and generation
Official implementation of SEED-LLaMA (ICLR 2024).
576 stars
15 watching
31 forks
Language: Python
last commit: 2 months ago foundation-modelmultimodalvision-language
Related projects:
| Repository | Description | Stars |
|---|---|---|
| ailab-cvc/seed-bench | A benchmark for evaluating large language models' ability to process multimodal input | 315 |
 alpha-vllm/wemix-llm | An LLaMA-based multimodal language model with various instruction-following and multimodal variants. | 17 |
 khanrc/honeybee | An implementation of a multimodal language model using locality-enhanced projection techniques | 432 |
 mlpc-ucsd/bliva | A multimodal LLM designed to handle text-rich visual questions | 269 |
 pleisto/yuren-baichuan-7b | A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks | 72 |
 llava-vl/llava-interactive-demo | An all-in-one demo for interactive image processing and generation | 351 |
 lyuchenyang/macaw-llm | A multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation | 1,550 |
 nvlabs/eagle | Develops high-resolution multimodal LLMs by combining vision encoders and various input resolutions | 539 |
 multimodal-art-projection/omnibench | Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously. | 14 |
 yuliang-liu/monkey | A toolkit for building conversational AI models that can process images and text inputs. | 1,825 |
 bytedance/lynx-llm | A framework for training GPT4-style language models with multimodal inputs using large datasets and pre-trained models | 229 |
 dvlab-research/prompt-highlighter | An interactive control system for text generation in multi-modal language models | 132 |
| dvlab-research/llama-vid | An image-based language model that uses large language models to generate visual and text features from videos | 733 |
 neulab/pangea | An open-source multilingual large language model designed to understand and generate content across diverse languages and cultural contexts | 91 |
 runpeidong/dreamllm | A framework to build versatile Multimodal Large Language Models with synergistic comprehension and creation capabilities | 394 |