JiuTian-LION
by JiuTian-VL
[CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
AI summary
Visual Knowledge Model
This project integrates visual knowledge into large language models to improve their capabilities and reduce hallucinations.
- stars
- 124
- forks
- 6
- watching
- 13
Similar projects
Found by comparing what the projects do, not just their names.
VLIT model toolkit
A comprehensive dataset and evaluation framework for Vision-Language Instruction Tuning models
Visual enhancer for LLMs
Enhances language models by incorporating human-like eyes to improve visual comprehension and interaction with external world
Vision Language Model
Develops a PyTorch implementation of an enhanced vision language model
Model debiasing
Debiasing techniques to minimize hallucinations in large visual language models
Vision-Language Learning Model
Develops and trains models for vision-language learning with decoupled language pre-training
Vision Language Model
An implementation of a vision language model designed for mobile devices, utilizing a lightweight downsample projector and pre-trained language models.
Vision-Language Model
A multimodal AI model that enables real-world vision-language understanding applications
Visual Prompt Model
A system designed to enable large multimodal models to understand arbitrary visual prompts
Learning benchmark
A benchmarking suite for multimodal in-context learning models
Image captioner
An end-to-end image captioning system that uses large multi-modal models and provides tools for training, inference, and demo usage.
Multimodal LLM
A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks
Interactive Visualization Tool
An integration of VPython with Jupyter Notebook for interactive 3D visualization and simulation in scientific computing.
Visual Text Understanding
This project enables multi-modal language models to understand and generate text about visual content using referential comprehension.
Neural Network Toolkit
A pre-trained model and toolset for performing vision-and-language tasks using a specific neural network architecture.
Model validator
Analyzing and mitigating object hallucination in large vision-language models to improve their accuracy and reliability.
