WeMix-LLM

Multimodal LLM

An LLaMA-based multimodal language model with various instruction-following and multimodal variants.

GitHub

17 stars
2 watching
0 forks
last commit: almost 3 years ago

Related projects:

RepositoryDescriptionStars
ailab-cvc/seedAn implementation of a multimodal language model with capabilities for comprehension and generation585
lyuchenyang/macaw-llmA multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation1,568
neulab/pangeaAn open-source multilingual large language model designed to understand and generate content across diverse languages and cultural contexts92
victordibia/llmxAn API that provides a unified interface to multiple large language models for chat fine-tuning79
nlpai-lab/kullmKorea University Large Language Model developed by researchers at Korea University and HIAI Research Institute.576
damo-nlp-mt/polylmA polyglot large language model designed to address limitations in current LLM research and provide better multilingual instruction-following capability.77
km1994/llmsninestorydemontowerExploring various LLMs and their applications in natural language processing and related areas1,854
pleisto/yuren-baichuan-7bA multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks73
phellonchen/x-llmA framework that enables large language models to process and understand multimodal inputs from various sources such as images and speech.308
jpmcb/nvim-llamaAn interface for integrating large language models into Neovim, enabling chat functionality and other LLM-based capabilities.263
will-singularity/skywork-mmAn empirical study aiming to develop a large language model capable of effectively integrating multiple input modalities23
eugeneyan/open-llmsA curated list of commercial-use large language models11,314
vita-mllm/vitaA large multimodal language model designed to process and analyze video, image, text, and audio inputs in real-time.1,005
kurama622/llm.nvimEnables users to interact with large language models within Neovim for tasks like code optimization and translation.65
mbzuai-oryx/groundinglmmAn end-to-end trained model capable of generating natural language responses integrated with object segmentation masks for interactive visual conversations797