seaweedfs
Filesystem
A fast distributed storage system for blobs, objects, files, and data lake.
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
23k stars
536 watching
2k forks
Language: Go
last commit: 3 months ago
Linked from 8 awesome lists
blob-storagecloud-drivedistributed-file-systemdistributed-storagedistributed-systemserasure-codingfusehadoop-hdfshdfskubernetesobject-storageposixreplications3s3-storageseaweedfstiered-file-system
awesome-selfhosted/awesome-selfhosted
avelino/awesome-go
oxnr/awesome-bigdata
igorbarinov/awesome-data-engineering
buraksezer/consistent
kelvins/awesome-dataops
xwjdsh/awesome-go-extra
monksy/awesome-data-engineeringRelated projects:
| Repository | Description | Stars |
|---|---|---|
| seaweedfs/seaweedfs-csi-driver | A container storage interface driver for a distributed file system | 227 |
| seaweedfs/seaweedfs-operator | A Kubernetes Operator that automates the deployment and management of SeaweedFS clusters. | 176 |
 linxgnu/goseaweedfs | A complete Golang client for interacting with the SeaweedFS distributed file system | 113 |
 moosefs/moosefs | A distributed file system designed to be highly reliable and scalable, providing efficient storage and management of large amounts of data across a network of servers. | 1,715 |
 gofiber/storage | Provides a unified interface to various storage systems and databases | 277 |
 eximua/filego | A decentralized storage platform providing a secure and accessible way to store and manage files. | 20 |
 ipfs/helia | An implementation of IPFS in TypeScript, enabling data storage and retrieval over a decentralized network. | 997 |
 holepunchto/hyperdrive | A distributed file system with real-time access and secure data storage | 1,874 |
 c2fo/vfs | A pluggable and extensible virtual file system library for Go | 311 |
 danilop/yas3fs | A distributed file system in userspace interface to Amazon S3 with support for caching and synchronization via notifications. | 644 |
 guardianproject/libsqlfs | A library that provides a full read/write file system in a single file on top of an SQLite database | 614 |
 cortexfoundation/torrentfs | An elastic file system that enables peer-to-peer file sharing and seeding over a decentralized network | 64 |
 robinrodricks/fluentstorage | Provides a unified API to interface with multiple cloud storage providers and messaging services from a single unified interface. | 302 |
 dbuschman7/mongofs | An enhanced file storage implementation for MongoDB that adds features and capabilities to the existing GridFS functionality | 20 |
 alexanderyw/adonis-drive-azure-storage | An Azure Storage driver for a file system abstraction layer in the Adonis Framework | 11 |