exo
AI model runner
Allows developers to run AI models on personal devices with diverse hardware configurations.
Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
15k stars
109 watching
796 forks
Language: Python
last commit: 5 days ago
Linked from 1 awesome list
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
 zylon-ai/private-gpt | An AI project providing an API to build private, context-aware applications using Large Language Models, with a focus on data privacy and security. | 54,192 |
 autumnai/leaf | An open machine learning framework for building classical, deep, or hybrid models on various hardware platforms. | 5,558 |
 openvinotoolkit/openvino | A toolkit for optimizing and deploying artificial intelligence models in various applications | 7,279 |
 othersideai/self-operating-computer | An operating system framework for multimodal models to control computers | 8,861 |
 axolotl-ai-cloud/axolotl | A tool designed to streamline AI model fine-tuning with support for multiple configurations and architectures. | 7,915 |
 bentoml/bentoml | An open-source Python framework for building model inference APIs and serving AI models in production environments. | 7,153 |
 significant-gravitas/autogpt | A platform for building and deploying autonomous AI agents to automate complex workflows | 168,407 |
 josh-xt/agixt | An AI platform that orchestrates instruction management and complex task execution across multiple AI providers | 2,648 |
 llmware-ai/llmware | A framework for building enterprise LLM-based applications using small, specialized models | 6,651 |
 portkey-ai/gateway | A fast and reliable AI routing service with built-in guardrails for generating requests to multiple large language models. | 6,290 |
 eleutherai/gpt-neox | Provides a framework for training large-scale language models on GPUs with advanced features and optimizations. | 6,941 |
 hpcaitech/colossalai | Making large AI models cheaper, faster, and more accessible by providing tools and strategies for efficient distributed training and inference. | 38,797 |
 ai-shifu/chatall | A platform that enables concurrent interaction with multiple AI chatbots to find the best answers. | 15,241 |
 tencent/pocketflow | A framework that automatically compresses and accelerates deep learning models to make them suitable for mobile devices with limited computational resources. | 2,788 |
 lightning-ai/pytorch-lightning | A framework for building and training AI models on multiple GPUs or TPUs with minimal code changes. | 28,402 |