Libra

Decoupled vision system

An implementation of a decoupled vision system using large language models

Simple PyTorch implementation of "Libra: Building Decoupled Vision System on Large Language Models" (accepted by ICML 2024)

GitHub

153 stars
2 watching
2 forks
Language: Python
last commit: almost 2 years ago

Related projects:

RepositoryDescriptionStars
yiren-jian/blitextDevelops and trains models for vision-language learning with decoupled language pre-training24
yfzhang114/llava-alignDebiasing techniques to minimize hallucinations in large visual language models75
shizhediao/davinciImplementing a unified modal learning framework for generative vision-language models43
algolzw/daclip-uirThis project controls vision-language models to restore degraded images in various environments and conditions.673
byungkwanlee/moaiImproves performance of vision language tasks by integrating computer vision capabilities into large language models314
jiahuadong/fissImplementations of federated incremental semantic segmentation in PyTorch.34
byungkwanlee/collavoDevelops a PyTorch implementation of an enhanced vision language model93
luispedro/mahotasA library of fast computer vision algorithms implemented in C++ for speed, operating over numpy arrays.855
luogen1996/lavinAn open-source implementation of a vision-language instructed large language model513
yunlongdong/fcn-pytorchA PyTorch implementation of FCN for semantic segmentation with an easy-to-use interface and pre-trained models.161
fyu/dilationThis project provides a deep learning framework implementing dilated convolutions for semantic image segmentation782
nickjiang2378/vl-interpThis project provides an official PyTorch implementation of a method to interpret and edit vision-language representations to mitigate hallucinations in image captions.46
yiyangzhou/lureAnalyzing and mitigating object hallucination in large vision-language models to improve their accuracy and reliability.136
codeslake/ifanImplementation of an algorithm for single image deblurring in images with defocus blur228
baaivision/eveA PyTorch implementation of an encoder-free vision-language model that can be fine-tuned for various tasks and modalities246