exo
AI cluster framework
An experimental software framework to run AI models on diverse devices without requiring expensive GPUs.
Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
17k stars
123 watching
936 forks
Language: Python
last commit: almost 2 years agoLinked from 1 awesome list
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
 zylon-ai/private-gpt | An AI project providing an API to build private, context-aware applications using Large Language Models, with a focus on data privacy and security. | 54,447 |
 autumnai/leaf | An open machine learning framework for building classical, deep, or hybrid models on various hardware platforms. | 5,555 |
 openvinotoolkit/openvino | A toolkit for optimizing and deploying artificial intelligence models in various applications | 7,439 |
 othersideai/self-operating-computer | A framework that enables multimodal models to control computers. | 8,977 |
 axolotl-ai-cloud/axolotl | A tool designed to streamline AI model fine-tuning, supporting multiple configurations and architectures. | 8,090 |
 bentoml/bentoml | An open-source Python framework for building model inference APIs and serving AI models in production environments. | 7,222 |
 significant-gravitas/autogpt | A platform for building and deploying autonomous AI agents to automate complex workflows | 169,186 |
 josh-xt/agixt | An AI platform that orchestrates instruction management and complex task execution across multiple AI providers | 2,674 |
 llmware-ai/llmware | A framework for building enterprise LLM-based applications using small, specialized models | 8,303 |
 portkey-ai/gateway | A fast and secure routing service for integrating with large language models | 6,557 |
 eleutherai/gpt-neox | Provides a framework for training large-scale language models on GPUs with advanced features and optimizations. | 6,997 |
 hpcaitech/colossalai | A toolkit for training and deploying large AI models in parallel on distributed computing infrastructure | 38,907 |
 ai-shifu/chatall | A platform that enables concurrent interaction with multiple AI chatbots to find the best answers. | 15,332 |
 tencent/pocketflow | A framework that automatically compresses and accelerates deep learning models to make them suitable for mobile devices with limited computational resources. | 2,787 |
 lightning-ai/pytorch-lightning | A framework for building and training AI models on multiple GPUs or TPUs with minimal code changes. | 28,636 |