mm-cot
Official implementation for "Multimodal Chain-of-Thought Reasoning in Language Models" (stay tuned and more will be updated)
AI summary
Multimodal reasoning model
An implementation of multimodal chain-of-thought reasoning in language models using a decoupled training framework for rationale generation and answer inference.
- stars
- 3.8K
- forks
- 317
- watching
- 56
Similar projects
Found by comparing what the projects do, not just their names.
Visual reasoning engine
A framework for training multi-modal language models with a focus on visual inputs and providing interpretable thoughts.
Mixture of Experts Model
A large vision-language model using a mixture-of-experts architecture to improve performance on multi-modal learning tasks
Vision-LM Framework
An open-source framework for training large language models with vision capabilities.
Image describer
A system for generating image descriptions using neural networks
Prompting library
This implementation provides tools and methods for multimodal reasoning in language models through prompting.
ScienceQA toolkit
A dataset and software framework for building multimodal reasoning systems to answer science questions.
nvlabs/prismer1.3K
Vision-Language Model
A deep learning framework for training multi-modal models with vision and language capabilities.
Multi-modal ML framework
An implementation of a unified architecture for multi-modal multi-task learning using PyTorch.
Vision-Language Learning Model
Develops and trains models for vision-language learning with decoupled language pre-training
ML explanations
An explanation of key concepts and advancements in the field of Machine Learning
open-mmlab/mmcv5.9K
Computer Vision Library
Provides a foundational library for computer vision research and training deep learning models with high-quality implementation of common CPU and CUDA ops.
Multimodal model trainer
An implementation of a multimodal LLM training paradigm to enhance truthfulness and ethics in language models
Vision Language Integrator
Improves performance of vision language tasks by integrating computer vision capabilities into large language models
Segmentation Model Library
A comprehensive library for training and applying deep learning models for image segmentation
Vision Reasoning Framework
A deep learning framework for iteratively decomposing vision and language reasoning via large language models.
