lynx-llm
Multimodal LLM framework
A framework for training GPT4-style language models with multimodal inputs using large datasets and pre-trained models
paper: https://arxiv.org/abs/2307.02469 page: https://lynx-llm.github.io/
231 stars
8 watching
8 forks
Language: Python
last commit: over 1 year ago research
Related projects:
| Repository | Description | Stars |
|---|---|---|
 phellonchen/x-llm | A framework that enables large language models to process and understand multimodal inputs from various sources such as images and speech. | 308 |
 lyuchenyang/macaw-llm | A multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation | 1,568 |
 pleisto/yuren-baichuan-7b | A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks | 73 |
 gmftbygmftby/science-llm | A large-scale language model for scientific domain training on redpajama arXiv split | 125 |
 yuliang-liu/monkey | An end-to-end image captioning system that uses large multi-modal models and provides tools for training, inference, and demo usage. | 1,849 |
 damo-nlp-mt/polylm | A polyglot large language model designed to address limitations in current LLM research and provide better multilingual instruction-following capability. | 77 |
 csuhan/onellm | A framework for training and fine-tuning multimodal language models on various data types | 601 |
 runpeidong/dreamllm | A framework to build versatile Multimodal Large Language Models with synergistic comprehension and creation capabilities | 402 |
 ailab-cvc/seed | An implementation of a multimodal language model with capabilities for comprehension and generation | 585 |
 luogen1996/lavin | An open-source implementation of a vision-language instructed large language model | 513 |
 bobazooba/xllm | A tool for training and fine-tuning large language models using advanced techniques | 387 |
 qcri/llmebench | A benchmarking framework for large language models | 81 |
 volcengine/vescale | A PyTorch-based framework for training large language models in parallel on multiple devices | 679 |
 wgryc/phasellm | A framework for managing and testing large language models to evaluate their performance and optimize user experiences. | 451 |
 internlm/lagent | A lightweight framework for building agent-based applications using LLMs and transformer architectures | 1,924 |