VIMA
by vimalabs
Official Algorithm Implementation of ICML'23 Paper "VIMA: General Robot Manipulation with Multimodal Prompts"
AI summary
Robot learner
An implementation of a general-purpose robot learning model using multimodal prompts
- stars
- 781
- forks
- 88
- watching
- 17
Similar projects
Found by comparing what the projects do, not just their names.
Multimodal LLM
An implementation of a multimodal language model with capabilities for comprehension and generation
ML model builder
Automatically builds multiple machine learning models using a single line of code.
Robotics simulator
Educational tool for robotics that bridges theory and practice using MATLAB
Robot Navigation
Develops robot navigation policies in crowded spaces using reinforcement learning and attention mechanisms.
Multimodal Chatbot
Trains a multimodal chatbot that combines visual and language instructions to generate responses
Image processor
An all-in-one demo for interactive image processing and generation
Multimodal model
A large multimodal model for visual question answering, trained on a dataset of 2.1B image-text pairs and 8.2M instruction sequences.
Text classifier
A Python package implementing an interpretable machine learning model for text classification with visualization tools
Text controller
An interactive control system for text generation in multi-modal language models
LLM trainer
Transfers visual prompt generators across large language models to reduce training costs and enable customization of multimodal LLMs
Multimodal benchmarking
Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously.
EVM tools
Utilities for interacting with the Ethereum virtual machine
Model Training Script
A tutorial project on teaching model training scripts using Config API Catalyst
Multimodal evaluation framework
Develops a multimodal task and dataset to assess vision-language models' ability to handle interleaved image-text inputs.
Test generator
Automates test generation based on user input and system behavior models.
