Dolphins
Driving Model
A multimodal language model designed to process video and text data for driving scenarios
[ECCV 2024] The official code for "Dolphins: Multimodal Language Model for Driving“
42 stars
3 watching
6 forks
Language: Python
last commit: 4 months ago Related projects:
| Repository | Description | Stars |
|---|---|---|
 vcciv/blvd | A large-scale 5D semantics benchmark for autonomous driving | 170 |
 pjlab-adg/gpt4v-ad-exploration | An autonomous driving project exploring the capabilities of a visual-language model in understanding complex driving scenes and making decisions | 287 |
 yfzhang114/slime | Develops large multimodal models for high-resolution understanding and analysis of text, images, and other data types. | 137 |
 affinis-lab/core | A deep learning module for stateful imitation learning in autonomous driving simulations. | 5 |
 360cvgroup/360vl | A large multi-modal model developed using the Llama3 language model, designed to improve image understanding capabilities. | 30 |
 nvlabs/prismer | A deep learning framework for training multi-modal models with vision and language capabilities. | 1,298 |
 shizhediao/davinci | An implementation of vision-language models for multimodal learning tasks, enabling generative vision-language models to be fine-tuned for various applications. | 43 |
 enginbozkurt/selfdrivingcarscontroldesign | Designs and simulates autonomous vehicle control systems using Python and Carla Simulator. | 117 |
 yuliang-liu/monkey | A toolkit for building conversational AI models that can process images and text inputs. | 1,825 |
 ailab-cvc/seed | An implementation of a multimodal language model with capabilities for comprehension and generation | 576 |
 mlpc-ucsd/bliva | A multimodal LLM designed to handle text-rich visual questions | 269 |
 dvlab-research/prompt-highlighter | An interactive control system for text generation in multi-modal language models | 132 |
 openbmb/viscpm | A family of large multimodal models supporting multimodal conversational capabilities and text-to-image generation in multiple languages | 1,089 |
 onlytailei/carla_cil_pytorch | Implementation of a conditional imitation learning policy in PyTorch for autonomous driving using the Carla dataset. | 66 |
 thoenselaar/car-following-model | A Matlab implementation of a car following model | 46 |