Pink
by SY-Xuan
Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs
AI summary
Visual Text Understanding
This project enables multi-modal language models to understand and generate text about visual content using referential comprehension.
- stars
- 79
- forks
- 5
- watching
- 4
Similar projects
Found by comparing what the projects do, not just their names.
Visual Model
Develops a multimodal Chinese language model with visual capabilities
lxtgh/omg-seg1.3K
Visual Model
Develops an end-to-end model for multiple visual perception and reasoning tasks using a single encoder, decoder, and large language model.
Learning benchmark
A benchmarking suite for multimodal in-context learning models
Text classifier
A Python package implementing an interpretable machine learning model for text classification with visualization tools
Image captioner
An end-to-end image captioning system that uses large multi-modal models and provides tools for training, inference, and demo usage.
Multimodal alignment model
Extending pretraining models to handle multiple modalities by aligning language and video representations
Visual Knowledge Model
This project integrates visual knowledge into large language models to improve their capabilities and reduce hallucinations.
Text controller
An interactive control system for text generation in multi-modal language models
Multimodal LLM
A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks
Multimodal model developer
Develops large multimodal models for high-resolution understanding and analysis of text, images, and other data types.
Chinese language model
Trains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks
Vision-Language Learning Model
Develops and trains models for vision-language learning with decoupled language pre-training
Visual enhancer for LLMs
Enhances language models by incorporating human-like eyes to improve visual comprehension and interaction with external world
Visual search framework
PyTorch implementation of guided visual search mechanism for multimodal LLMs
Visualization library
A collection of R visualization tools and utilities for creating color palettes, themes, and visualizing statistical models.
