Dolphins
Driving Model
A multimodal language model designed to process video and text data for driving scenarios
[ECCV 2024] The official code for "Dolphins: Multimodal Language Model for Driving“
51 stars
3 watching
9 forks
Language: Python
last commit: 6 months ago Related projects:
| Repository | Description | Stars |
|---|---|---|
 vcciv/blvd | A large-scale 5D semantics benchmark for autonomous driving | 171 |
 pjlab-adg/gpt4v-ad-exploration | An autonomous driving project exploring the capabilities of a visual-language model in understanding complex driving scenes and making decisions | 288 |
 yfzhang114/slime | Develops large multimodal models for high-resolution understanding and analysis of text, images, and other data types. | 143 |
 affinis-lab/core | A deep learning module for stateful imitation learning in autonomous driving simulations. | 5 |
 360cvgroup/360vl | A large multi-modal model developed using the Llama3 language model, designed to improve image understanding capabilities. | 32 |
 nvlabs/prismer | A deep learning framework for training multi-modal models with vision and language capabilities. | 1,299 |
 shizhediao/davinci | Implementing a unified modal learning framework for generative vision-language models | 43 |
 enginbozkurt/selfdrivingcarscontroldesign | Designs and simulates autonomous vehicle control systems using Python and Carla Simulator. | 117 |
 yuliang-liu/monkey | An end-to-end image captioning system that uses large multi-modal models and provides tools for training, inference, and demo usage. | 1,849 |
 ailab-cvc/seed | An implementation of a multimodal language model with capabilities for comprehension and generation | 585 |
 mlpc-ucsd/bliva | A multimodal LLM designed to handle text-rich visual questions | 270 |
 dvlab-research/prompt-highlighter | An interactive control system for text generation in multi-modal language models | 135 |
 openbmb/viscpm | A family of large multimodal models supporting multimodal conversational capabilities and text-to-image generation in multiple languages | 1,098 |
 onlytailei/carla_cil_pytorch | Implementation of a conditional imitation learning policy in PyTorch for autonomous driving using the Carla dataset. | 65 |
 thoenselaar/car-following-model | A Matlab implementation of a car following model | 48 |