ChatBridge
by joez17
ChatBridge, an approach to learning a unified multimodal model to interpret, correlate, and reason about various modalities without relying on all combinations of paired data.
AI summary
Multimodal Model
A unified multimodal language model capable of interpreting and reasoning about various modalities without paired data.
- stars
- 49
- forks
- 1
- watching
- 2
Similar projects
Found by comparing what the projects do, not just their names.
Multimodal bridge
A framework for building multimodal foundation models that can serve as bridges between different modalities and language models.
Chat bridge
A bridge that connects multiple chat protocols to a unified interface
Chat model wrapper
Provides a framework for creating custom chat models with dynamic failover and load balancing features
Multimodal benchmarking
Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously.
Language Model
An 8B and 13B language model based on the Llama architecture with multilingual capabilities.
Language model chat client
An iOS app that provides a chat interface to local large language models, optimized for Apple silicon.
openbmb/viscpm1.1K
Multimodal Models
A family of large multimodal models supporting multimodal conversational capabilities and text-to-image generation in multiple languages
Image captioner
An end-to-end image captioning system that uses large multi-modal models and provides tools for training, inference, and demo usage.
Multimodal LLM
A multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation
Chat bridge
A tool that enables communication between Delta Chat and other supported chat services using Matterbridge.
Multimodal model
A large multimodal model for visual question answering, trained on a dataset of 2.1B image-text pairs and 8.2M instruction sequences.
Multimodal model framework
A framework for grounding language models to images and handling multimodal inputs and outputs
Chat model
An open-source chat model built on top of the 52B large language model, with improvements in position encoding, activation function, and layer normalization.
Multimodal LLM
A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks
Multitask model
A unified model for image, video, audio, and language tasks that can be fine-tuned for various downstream applications.
