Sight-Beyond-Text
by UCSC-VLAA
[TMLR 2024] Official implementation of "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
AI summary
Multimodal model trainer
An implementation of a multimodal LLM training paradigm to enhance truthfulness and ethics in language models
- stars
- 19
- forks
- 1
- watching
- 2
Similar projects
Found by comparing what the projects do, not just their names.
VQA model
A multimodal LLM designed to handle text-rich visual questions
Vision model safety test
A benchmark for evaluating the safety and robustness of vision language models against adversarial attacks.
LLM trainer
Transfers visual prompt generators across large language models to reduce training costs and enable customization of multimodal LLMs
Multimodal LLM
An implementation of a multimodal language model with capabilities for comprehension and generation
Multimodal LLM
A multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation
aidc-ai/ovis575
Multimodal aligner
An MLLM architecture designed to align visual and textual embeddings through structural alignment
Multimodal conversational model
An end-to-end trained model capable of generating natural language responses integrated with object segmentation masks for interactive visual conversations
Multimodal LLM
A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks
Model trainer
A platform for training and deploying large language and vision models that can use tools to perform tasks
Vision-Language Model Trainer
This is an open-source project that proposes a novel method to train large-scale vision-language models with minimal resources and no fine-tuning required.
Language model trainer
A framework for training and fine-tuning multimodal language models on various data types
Visual Instruction Tuning
An open-source project that enhances visual instruction tuning for text-rich image understanding by integrating GPT-4 models with multimodal datasets.
Multimodal LLM
An LLaMA-based multimodal language model with various instruction-following and multimodal variants.
LLM trainer
A tool for training and fine-tuning large language models using advanced techniques
Multimodal LLM
An open-source multilingual large language model designed to understand and generate content across diverse languages and cultural contexts
