Skywork-MM
Empirical Study Towards Building An Effective Multi-Modal Large Language Model
AI summary
Multi-modal language model
An empirical study aiming to develop a large language model capable of effectively integrating multiple input modalities
- stars
- 23
- forks
- 1
- watching
- 2
Similar projects
Found by comparing what the projects do, not just their names.
MoE model
A high-performance mixture-of-experts model with innovative training techniques for language processing tasks
Multilingual model
A pre-trained language model developed on 3.2TB of high-quality multilingual and code data for various applications including chatbots, text generation, and math calculations.
Multimodal LLM
A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks
Multilingual models
Large language models designed to perform well in multiple languages and address performance issues with current multilingual models.
Multimodal LLM
An LLaMA-based multimodal language model with various instruction-following and multimodal variants.
Multimodal LLM
A multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation
Multimodal conversational model
An end-to-end trained model capable of generating natural language responses integrated with object segmentation masks for interactive visual conversations
Language models
A collection of lightweight state-of-the-art language models designed to support multilinguality, coding, and reasoning tasks on constrained resources.
Multi-modal model evaluation suite
A collection of benchmarks to evaluate the multi-modal understanding capability of large vision language models.
Multimodal benchmarking
Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously.
Image captioner
An end-to-end image captioning system that uses large multi-modal models and provides tools for training, inference, and demo usage.
openbmb/viscpm1.1K
Multimodal Models
A family of large multimodal models supporting multimodal conversational capabilities and text-to-image generation in multiple languages
Language Model
An implementation of a neural network model for character-level language modeling.
Multimodal LLM
An open-source multilingual large language model designed to understand and generate content across diverse languages and cultural contexts
Multimodal alignment model
Extending pretraining models to handle multiple modalities by aligning language and video representations
