fromage
by kohjingyu
🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".
AI summary
Multimodal model framework
A framework for grounding language models to images and handling multimodal inputs and outputs
- stars
- 478
- forks
- 35
- watching
- 12
Similar projects
Found by comparing what the projects do, not just their names.
Image captioner
An end-to-end image captioning system that uses large multi-modal models and provides tools for training, inference, and demo usage.
Image generator
A software framework for generating images and text using large language models
Multimodal conversational model
An end-to-end trained model capable of generating natural language responses integrated with object segmentation masks for interactive visual conversations
Multimodal LLM
A multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation
baaivision/emu1.7K
Model framework
A multimodal generative model framework
Multimodal evaluation framework
Develops a multimodal task and dataset to assess vision-language models' ability to handle interleaved image-text inputs.
Multimodal alignment model
Extending pretraining models to handle multiple modalities by aligning language and video representations
Vision-Language Model Framework
Implementing a unified modal learning framework for generative vision-language models
openbmb/viscpm1.1K
Multimodal Models
A family of large multimodal models supporting multimodal conversational capabilities and text-to-image generation in multiple languages
Multimodal model developer
Develops large multimodal models for high-resolution understanding and analysis of text, images, and other data types.
Multimodal benchmarking
Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously.
Image Description Model
Trains multilingual image description models using neural sequence models and extracts hidden features from trained models.
Multimodal Model
A unified multimodal language model capable of interpreting and reasoning about various modalities without paired data.
Language model trainer
A framework for training large language models that prioritizes legibility, scalability, and reproducibility
ML framework
A collection of tools and guidelines for building responsible machine learning models
