aistore
AI storage system
A scalable storage system designed to support large-scale AI applications with flexible deployment options and high availability.
AIStore: scalable storage for AI applications
1k stars
47 watching
176 forks
Language: Go
last commit: 2 months ago
Linked from 1 awesome list
batch-jobsdistributed-shuffleerasure-codingetl-offloadkuberneteslinear-scalabilitymultiple-backendsnetwork-of-clustersobject-storagesdssoftware-defined
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
 albrow/zoom | A high-performance, low-latency data storage and querying system for Go applications. | 309 |
 intelligentnode/intelliserver | A framework providing unified access to multiple AI models as microservices for integration into software projects | 27 |
 google/tensorstore | A C++ and Python library for storing and manipulating large multi-dimensional arrays in various formats and storage systems. | 1,362 |
 iterative/datachain | A Python-based framework for transforming and analyzing unstructured data from various formats like images, audio, videos, text, and PDFs. | 2,088 |
 alibaba/tair | A distributed key-value storage system designed to provide high performance and scalability | 2,195 |
 aofdev/vuefire-storage | A Vue.js project demonstrating integration of Firebase Storage with VueFire to provide storage capabilities. | 25 |
 holepunchto/hyperdrive | A distributed file system with real-time access and secure data storage | 1,874 |
 mergesort/bodega | A data layer library providing a simple and unified way to store and manage app data in an actor-based architecture. | 321 |
 linkedin/ambry | A distributed object store designed to efficiently store and serve large media objects in web applications. | 1,749 |
 platformlab/ramcloud | A high-performance storage system designed for low-latency access to large-scale datacenter applications with strong consistency and durability. | 491 |
 tiledb-inc/tiledb | A powerful storage engine for dense and sparse multi-dimensional arrays, providing efficient data modeling and access. | 1,878 |
 bytehub-ai/bytehub | A Python-based feature store library with a simple, scalable, and flexible architecture for storing and managing data for machine learning applications. | 58 |
 alexanderyw/adonis-drive-azure-storage | An Azure Storage driver for a file system abstraction layer in the Adonis Framework | 11 |
 huo-ju/dfserver | A distributed backend AI pipeline server for building and managing GPU clusters to run various AI models. | 349 |
 eximua/filego | A decentralized storage platform providing a secure and accessible way to store and manage files. | 20 |