LLaVA
by haotian-liu
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
AI summary
Visual Instruction System
A system that uses large language and vision models to generate and process visual instructions
- stars
- 20.7K
- forks
- 2.3K
- watching
- 159
Similar projects
Found by comparing what the projects do, not just their names.
Multimodal model developer
Develops large multimodal models for various computer vision tasks including image and video analysis
GPT-4 data generator
This project generates instruction-following data using GPT-4 to fine-tune large language models for real-world tasks.
Instruction-following model tuner
An implementation of a method for fine-tuning language models to follow instructions with high efficiency and accuracy
Video generator
A deep learning framework for generating videos from text inputs and visual features.
LLaMA Tuner
A tool for efficiently fine-tuning large language models across multiple architectures and methods.
Vision-LM Framework
An open-source framework for training large language models with vision capabilities.
LLM toolkit
An open-source toolkit for pretraining and fine-tuning large language models
Visual Instruction Tuning
An open-source project that enhances visual instruction tuning for text-rich image understanding by integrating GPT-4 models with multimodal datasets.
LLaMA model trainer
An instruction-following Chinese LLaMA-based model project aimed at training and fine-tuning models on specific hardware configurations for efficient deployment.
Video understanding model
An audio-visual language model designed to understand and respond to video content with improved instruction-following capabilities
luodian/otter3.6K
Multi-modal AI model
A multi-modal AI model developed for improved instruction-following and in-context learning, utilizing large-scale architectures and various training datasets.
qwenlm/qwen-vl5.2K
Large vision language model
A large vision language model with improved image reasoning and text recognition capabilities, suitable for various multimodal tasks
Server framework
A fast serving framework for large language models and vision language models.
Evaluation framework
Provides a unified framework to test generative language models on various evaluation tasks.
tloen/alpaca-lora18.7K
Language model tuning
Tuning a large language model on consumer hardware using low-rank adaptation
