WeMix-LLM

Multimodal LLM

An LLaMA-based multimodal language model with various instruction-following and multimodal variants.

GitHub

17 stars
2 watching
0 forks
last commit: about 1 year ago

Related projects:

Repository Description Stars
ailab-cvc/seed An implementation of a multimodal language model with capabilities for comprehension and generation 582
lyuchenyang/macaw-llm A multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation 1,550
neulab/pangea An open-source multilingual large language model designed to understand and generate content across diverse languages and cultural contexts 91
victordibia/llmx An API that provides a unified interface to multiple large language models for chat fine-tuning 79
nlpai-lab/kullm Korea University Large Language Model developed by researchers at Korea University and HIAI Research Institute. 569
damo-nlp-mt/polylm A polyglot large language model designed to address limitations in current LLM research and provide better multilingual instruction-following capability. 76
km1994/llmsninestorydemontower Exploring various LLMs and their applications in natural language processing and related areas 1,798
pleisto/yuren-baichuan-7b A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks 72
phellonchen/x-llm A framework that enables large language models to process and understand multimodal inputs from various sources such as images and speech. 306
jpmcb/nvim-llama An interface for integrating large language models into Neovim, enabling chat functionality and other LLM-based capabilities. 259
will-singularity/skywork-mm An empirical study aiming to develop a large language model capable of effectively integrating multiple input modalities 23
eugeneyan/open-llms A curated list of commercial-use large language models 11,222
vita-mllm/vita A large multimodal language model designed to process and analyze video, image, text, and audio inputs in real-time. 961
kurama622/llm.nvim An extension for Neovim that integrates with large language models to provide tools for text translation, code explanation and optimization. 47
mbzuai-oryx/groundinglmm An end-to-end trained model capable of generating natural language responses integrated with object segmentation masks. 781