aistore
AI storage system
A scalable storage system designed to support large-scale AI applications with flexible deployment options and high availability.
AIStore: scalable storage for AI applications
1k stars
46 watching
174 forks
Language: Go
last commit: 5 days ago
Linked from 1 awesome list
batch-jobsdistributed-shuffleerasure-codingetl-offloadkuberneteslinear-scalabilitymultiple-backendsnetwork-of-clustersobject-storagesdssoftware-defined
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
 albrow/zoom | A high-performance, low-latency data storage and querying system for Go applications. | 309 |
 intelligentnode/intelliserver | A framework providing unified access to multiple AI models as microservices for integration into software projects | 27 |
 google/tensorstore | A C++ and Python library for storing and manipulating large multi-dimensional arrays in various formats and storage systems. | 1,352 |
 iterative/datachain | An AI-data warehouse that transforms and analyzes unstructured data from various formats | 1,935 |
 alibaba/tair | A distributed key-value storage system designed to provide high performance and scalability | 2,193 |
 aofdev/vuefire-storage | A Vue.js project demonstrating integration of Firebase Storage with VueFire to provide storage capabilities. | 25 |
 holepunchto/hyperdrive | A distributed file system with real-time access and secure data storage | 1,868 |
 mergesort/bodega | A data layer library providing a simple and unified way to store and manage app data in an actor-based architecture. | 319 |
 linkedin/ambry | A distributed object store designed to handle large amounts of small and large immutable objects with high availability and low latency. | 1,751 |
 platformlab/ramcloud | A high-performance storage system designed for low-latency access to large-scale datacenter applications with strong consistency and durability. | 490 |
 tiledb-inc/tiledb | A powerful storage engine for dense and sparse multi-dimensional arrays, providing efficient data modeling and access. | 1,866 |
 bytehub-ai/bytehub | A Python-based feature store library with a simple, scalable, and flexible architecture for storing and managing data for machine learning applications. | 58 |
 alexanderyw/adonis-drive-azure-storage | An Azure Storage driver for a file system abstraction layer in the Adonis Framework | 11 |
 huo-ju/dfserver | A distributed backend AI pipeline server for building and managing GPU clusters to run various AI models. | 348 |
 eximua/filego | A decentralized storage platform providing a secure and accessible way to store and manage files. | 20 |