VLFeedback

Vision language model trainer

An annotated preference dataset and training framework for improving large vision language models.

GitHub

88 stars
2 watching
2 forks
Language: Python
last commit: over 2 years ago

Related projects:

RepositoryDescriptionStars
vishaal27/sus-xThis is an open-source project that proposes a novel method to train large-scale vision-language models with minimal resources and no fine-tuning required.94
yiren-jian/blitextDevelops and trains models for vision-language learning with decoupled language pre-training24
shizhediao/davinciImplementing a unified modal learning framework for generative vision-language models43
nvlabs/prismerA deep learning framework for training multi-modal models with vision and language capabilities.1,299
vlfeat/vlfeatA comprehensive computer vision library providing efficient algorithms for image analysis and feature extraction1,605
yuxie11/r2d2A framework for large-scale cross-modal benchmarks and vision-language tasks in Chinese157
deepseek-ai/deepseek-vlA multimodal AI model that enables real-world vision-language understanding applications2,145
meituan-automl/mobilevlmAn implementation of a vision language model designed for mobile devices, utilizing a lightweight downsample projector and pre-trained language models.1,076
baai-wudao/brivlPre-trains a multilingual model to bridge vision and language modalities for various downstream applications279
volcengine/vescaleA PyTorch-based framework for training large language models in parallel on multiple devices679
liaoning97/revo-lionA comprehensive dataset and evaluation framework for Vision-Language Instruction Tuning models11
chendelong1999/polite-flamingoDevelops training methods to improve the politeness and natural flow of multi-modal Large Language Models63
csuhan/onellmA framework for training and fine-tuning multimodal language models on various data types601
llava-vl/llava-plus-codebaseA platform for training and deploying large language and vision models that can use tools to perform tasks717
lyhue1991/torchkerasA PyTorch-based model training framework designed to simplify and streamline training workflows by providing a unified interface for various loss functions, optimizers, and validation metrics.1,822