WeMix-LLM

Multimodal LLM

An LLaMA-based multimodal language model with various instruction-following and multimodal variants.

GitHub

17 stars
2 watching
0 forks
last commit: over 1 year ago

Related projects:

Repository Description Stars
ailab-cvc/seed An implementation of a multimodal language model with capabilities for comprehension and generation 585
lyuchenyang/macaw-llm A multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation 1,568
neulab/pangea An open-source multilingual large language model designed to understand and generate content across diverse languages and cultural contexts 92
victordibia/llmx An API that provides a unified interface to multiple large language models for chat fine-tuning 79
nlpai-lab/kullm Korea University Large Language Model developed by researchers at Korea University and HIAI Research Institute. 576
damo-nlp-mt/polylm A polyglot large language model designed to address limitations in current LLM research and provide better multilingual instruction-following capability. 77
km1994/llmsninestorydemontower Exploring various LLMs and their applications in natural language processing and related areas 1,854
pleisto/yuren-baichuan-7b A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks 73
phellonchen/x-llm A framework that enables large language models to process and understand multimodal inputs from various sources such as images and speech. 308
jpmcb/nvim-llama An interface for integrating large language models into Neovim, enabling chat functionality and other LLM-based capabilities. 263
will-singularity/skywork-mm An empirical study aiming to develop a large language model capable of effectively integrating multiple input modalities 23
eugeneyan/open-llms A curated list of commercial-use large language models 11,314
vita-mllm/vita A large multimodal language model designed to process and analyze video, image, text, and audio inputs in real-time. 1,005
kurama622/llm.nvim Enables users to interact with large language models within Neovim for tasks like code optimization and translation. 65
mbzuai-oryx/groundinglmm An end-to-end trained model capable of generating natural language responses integrated with object segmentation masks for interactive visual conversations 797