VLGuard

Safety fine-tuner

Improves safety and helpfulness of large language models by fine-tuning them using safety-critical tasks

[ICML 2024] Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models.

GitHub

47 stars
3 watching
2 forks
Language: Python
last commit: about 2 years ago
alignmentlarge-language-modelslarge-vision-language-modelssafetyvision-language-model

Related projects:

RepositoryDescriptionStars
roboflow/maestroA tool to streamline fine-tuning of multimodal models for vision-language tasks1,415
ys-zong/vl-iclA benchmarking suite for multimodal in-context learning models31
icoz69/stablellavaA tool for generating and evaluating multimodal Large Language Models with visual instruction tuning capabilities93
x-plug/cvaluesEvaluates and aligns the values of Chinese large language models with safety and responsibility standards481
rlhf-v/rlhf-vAligns large language models' behavior through fine-grained correctional human feedback to improve trustworthiness and accuracy.245
ucsc-vlaa/vllm-safety-benchmarkA benchmark for evaluating the safety and robustness of vision language models against adversarial attacks.72
yfzhang114/llava-alignDebiasing techniques to minimize hallucinations in large visual language models75
liaoning97/revo-lionA comprehensive dataset and evaluation framework for Vision-Language Instruction Tuning models11
ymcui/macbertImproves pre-trained Chinese language models by incorporating a correction task to alleviate inconsistency issues with downstream tasks646
yiyangzhou/lureAnalyzing and mitigating object hallucination in large vision-language models to improve their accuracy and reliability.136
spandan-madan/pytorch_fine_tuning_tutorialProvides guidance on fine-tuning pre-trained models for image classification tasks using PyTorch.279
pku-alignment/safety-gymnasiumA unified benchmark for safe reinforcement learning algorithms and environments.410
pku-yuangroup/languagebindExtending pretraining models to handle multiple modalities by aligning language and video representations751
jerry1993-tech/cornucopia-llama-fin-chineseA Chinese finance-focused large language model fine-tuning framework596
brightmart/xlnet_zhTrains a large Chinese language model on massive data and provides a pre-trained model for downstream tasks230