Muffin
by thunlp
AI summary
Multimodal bridge
A framework for building multimodal foundation models that can serve as bridges between different modalities and language models.
- stars
- 59
- forks
- 3
- watching
- 8
Similar projects
Found by comparing what the projects do, not just their names.
Image captioner
An end-to-end image captioning system that uses large multi-modal models and provides tools for training, inference, and demo usage.
Multimodal Model
A unified multimodal language model capable of interpreting and reasoning about various modalities without paired data.
Multimodal benchmarking
Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously.
Network bridge
A general-purpose bridge that connects multiple networks and protocols using various backends.
mautrix/telegram1.4K
Bridge
Enables communication between Matrix and Telegram networks by bridging them together
Language bridge
A bridge between Ruby and Haskell allowing code reuse across the two languages
Bridge library
A library that allows building bridges between Matrix and remote services by automating logins and interactions.
Lisp-Python Bridge
A bridge between Common Lisp and Python, enabling interaction between the two languages through a separate process.
Bridge
A software bridge connecting Matrix and WhatsApp
Multi-modal ML framework
An implementation of a unified architecture for multi-modal multi-task learning using PyTorch.
yglukhov/nimpy1.5K
Nim-Python Bridge
A bridge between Nim and Python, allowing native language integration.
Lisp-Python bridge
An implementation of Python in Common Lisp, allowing mixed execution and library access between the two languages.
openbmb/viscpm1.1K
Multimodal Models
A family of large multimodal models supporting multimodal conversational capabilities and text-to-image generation in multiple languages
Multimodal model framework
A framework for grounding language models to images and handling multimodal inputs and outputs
Multimodal processor
A large multimodal language model designed to process and analyze video, image, text, and audio inputs in real-time.
