Dolphins
by SaFoLab-WISC
[ECCV 2024] The official code for "Dolphins: Multimodal Language Model for Driving“
AI summary
Driving Model
A multimodal language model designed to process video and text data for driving scenarios
- stars
- 51
- forks
- 9
- watching
- 3
Similar projects
Found by comparing what the projects do, not just their names.
vcciv/blvd171
Autonomous driving dataset
A large-scale 5D semantics benchmark for autonomous driving
Driving Model
An autonomous driving project exploring the capabilities of a visual-language model in understanding complex driving scenes and making decisions
Multimodal model developer
Develops large multimodal models for high-resolution understanding and analysis of text, images, and other data types.
Autonomous driving simulator
A deep learning module for stateful imitation learning in autonomous driving simulations.
Image understanding model
A large multi-modal model developed using the Llama3 language model, designed to improve image understanding capabilities.
nvlabs/prismer1.3K
Vision-Language Model
A deep learning framework for training multi-modal models with vision and language capabilities.
Vision-Language Model Framework
Implementing a unified modal learning framework for generative vision-language models
Autonomous controller
Designs and simulates autonomous vehicle control systems using Python and Carla Simulator.
Image captioner
An end-to-end image captioning system that uses large multi-modal models and provides tools for training, inference, and demo usage.
Multimodal LLM
An implementation of a multimodal language model with capabilities for comprehension and generation
VQA model
A multimodal LLM designed to handle text-rich visual questions
Text controller
An interactive control system for text generation in multi-modal language models
openbmb/viscpm1.1K
Multimodal Models
A family of large multimodal models supporting multimodal conversational capabilities and text-to-image generation in multiple languages
Driving policy
Implementation of a conditional imitation learning policy in PyTorch for autonomous driving using the Carla dataset.
Car simulator
A Matlab implementation of a car following model
