LL3DA
by Open3DA
[CVPR 2024] "LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning"; an interactive Large Language 3D Assistant.
AI summary
3D assistant
An interactive system for understanding and interacting with 3D environments using natural language.
- stars
- 255
- forks
- 10
- watching
- 6
Similar projects
Found by comparing what the projects do, not just their names.
3D LLM
Developing a Large Language Model capable of processing 3D representations as inputs
Image editing assistant
An implementation of a multimodal generation assistant using large language models and various image editing techniques.
3D dataset
An open-source software project providing a comprehensive 3D instruction-following dataset with multi-modal prompts for training large language models.
3D engine
An open source platform for developing interactive 3D graphics.
Dialog Agent
A system for an AI agent to engage in natural dialog about visual content using a combination of encoder and decoder architectures.
agenta-ai/agenta1.6K
LLM platform
An end-to-end platform for building and deploying large language model applications
Visual Model
Develops a multimodal Chinese language model with visual capabilities
aidc-ai/ovis575
Multimodal aligner
An MLLM architecture designed to align visual and textual embeddings through structural alignment
Multimodal Chatbot Framework
An open-source software framework that enables large language models to process and understand point cloud data, facilitating multimodal interactions.
Human simulation software
This project involves generating synthetic human data to train 3D models of human appearance and behavior.
3D rendering engine
An all-in-one 3D visualization library for C++, Python, Lua, and Go.
AI agent framework
A framework and benchmark for training and evaluating multi-modal large language models, enabling the development of AI agents capable of seamless interaction between humans and machines.
Biomedicine assistant
A research project aimed at building large language and vision models for biomedical applications with capabilities comparable to GPT-4.
3D graphics library
A Lua module for 3D graphics intended to provide a low-level API for abstracting away OpenGL details and enabling advanced techniques without the need for significant modifications to an existing game engine.
Game engine
Simplifies 3D rendering in the LÖVE game engine using Lua.
