self-operating-computer

Computer controller

A framework that enables multimodal models to control computers.

A framework to enable multimodal models to operate a computer.

GitHub

9k stars
130 watching
1k forks
Language: Python
last commit: about 2 months ago
automationopenaipyautogui

Related projects:

Repository Description Stars
chatgptnextweb/chatgpt-next-web A cross-platform UI solution for ChatGPT and Gemini AI models, allowing users to deploy their own private chat applications. 77,657
exo-explore/exo An experimental software framework to run AI models on diverse devices without requiring expensive GPUs. 17,369
melvin-abraham/google-assistant-unofficial-desktop-client A cross-platform desktop client for Google Assistant based on the official SDK 3,610
bin-huang/chatbox A desktop application for interacting with AI models and language learning platforms 23,791
flagai-open/flagai An open-source toolkit for training and deploying large-scale AI models on various downstream tasks with multi-modality 3,840
livekit/agents An open-source framework for building real-time, multimodal AI applications with flexible integrations and a focus on voice agents and conversational flow. 4,210
dvlab-research/mgm An open-source framework for training large language models with vision capabilities. 3,229
baaivision/emu A multimodal generative model framework 1,672
joonspk-research/generative_agents A research project simulating human behavior in interactive environments. 17,888
llmware-ai/llmware A framework for building enterprise LLM-based applications using small, specialized models 8,303
openvinotoolkit/open_model_zoo A collection of pre-trained deep learning models and demo applications for accelerating inference tasks 4,118
fiatrete/opendan-personal-ai-os A personal AI operating system integrating various AI modules and agents for automation and productivity 1,720
ther1d/shell_gpt A command-line tool using AI-powered language models to generate shell commands and code snippets 9,933
crewaiinc/crewai A framework for orchestrating role-playing, autonomous AI agents to work together seamlessly on complex tasks 22,550
jupyterlab/jupyter-ai Enables users to explore and utilize generative AI models within Jupyter notebooks. 3,274