awesome-distributed-systems

, Also explanation

, expect things to break,

, most of the papers/books in the blog might reappear in this list again. Still a good BFS approach to distributed systems

, an easier to follow along

An Introduction to Distributed Systems

@aphyr's excellent introduction to distributed systems

[Free]

[Free with registration]

[Free]

[Free] [ETH Zurich University]

, [Free] Joe Amstrong's (Author of Erlang) PhD thesis

[Amazon Link]

Distributed Machine Learning Patterns, Yuan Tang

, Practical patterns for scaling machine learning from your laptop to a distributed cluster

[Amazon Link]

[paywall]

[Free with registration]

[Amazon Link]

[Free with subscription]

Lamport's paper, the Quintessential distributed systems primer

a '94 paper that talks about various recommendations for session guarantees for eventually consistent systems, many of this would be standard vocabulary in reading other dist. sys papers, like monotonic reads, read your writes etc

Paraphrasing @fogus from their , it is very rare for a paper describing an active production system to influence the state of active research in any industry; this is one of those seminal distributed systems paper that solves the problem of a highly available and fault tolerant database in an elegant way, later paving the way for systems like Cassandra, and many other AP systems using a consistent hashing

Inspired heavily by Dynamo, an now an open source

, the algorithm for the basis of Ceph distributed storage system, for the architecture itself read

, a somewhat long read, but covers brilliantly on logs, which are at the heart of most distributed systems

Paxos, Lamport's original Paxos paper, a bit difficult to understand, may require multiple passes

, a more terse readable Paxos paper by Lamport himself. Shorter and more easier compared to the original

Google's lock service used for loosely coupled distributed systems. Sort of Paxos as a Service for building other distributed systems. Primary inspiration behind other Service Discovery & Coordination tools like Zookeeper, etcd, Consul etc

Google's learning while implementing systems atop of Paxos. Demonstrates various practical issues encountered while implementing a theoretical concept

An alternative to Paxos for distributed consensus, that is much simpler to understand. Do checkout an

presents an approach for Strong Eventual Consistency which as been applied in projects such as , and . A great talk on the subject by Martin Kleppmann can be found

Azos.Sky.Server.Locking

Speculative algorithms for global state synchronizations uses probability based QOS (Quality of Service)/Trust measure to ensure probability-based consensus. The approach avoids distributed state machine/phase synchronization and is very simple to understand and implement

, Google's large scale distributed-systems tracing infrastructure, this was also the basis for the design of open source projects such as , , and

Video:

Curated list of resources on includes links to materials on testing by various companies (Google, Amazon, Netflix, Microsoft, Dropbox, etc) and research papers

Jepsen

A framework for distributed systems verification, with fault injection @aphyr has featured enough times in this list already, but Jepsen and the blog posts that go with are a quintessntial addition to any distributed systems reading list

A Framework for Implementing and Formally Verifying Distributed Systems

interview series by

Distributed Systems in One Lesson by Tim Berglund

, KTH Sweden

, KTH Sweden

, University of Illinois

in Go Programming Language

, Georgia Tech

, covers Distributed control algorithms, communication models, fault-tolerance among other things. In particular fault tolerance issues (models, consensus, agreement) and replication issues (2PC,3PC, Paxos), which are critical in understanding distributed systems are explained in great detail

, A beginner course on distributed system by Chris Colohan, A google employee who contributed to SUIF, MapReduce, TCMalloc, Percolator, Caffeine, Borg, Omega, and Piper

, MIT distributed system lectures, in each video they discuss papers like GFS, Zookeeper, RAFT, Spanner

, Lectures 9 to 16 of the Cambridge University lecture "Concurrent and Distributed Systems", given by Dr. Martin Kleppmann. . A computer science entrance course, covered basic models and algorithms in distributed systems, also discussed CRDT, collaboration software and google's spanner

, a collection of Amazon's learnings on distributed systems

Several architectures of huge internet services, for eg ,

, Problems with simultaneity in distributed systems

, An article by Leslie Lamport on concurrency

blog, a very readable blog covering various aspects of distributed systems

, Posts on series are pretty awesome

Wernel Vogel's (Amazon CTO) blog on distributed systems

A blog post on filesystem consistency, pretty important to read if you are into distributed storage or databases

Testing distributed systems are hard enough, a well researched blog post which again covers a lot of links to various approaches and other papers

A blog post on popular SWIM failure detector

, a list of resources from PODC–DISC community including conference series, mailing lists, youtube, twitter, etc

, an international forum for engineers and scientists to present their latest research findings

, a journal about theory, design, specification, and implementation of distributed systems

Part of CMU's Engineering Distributed Systems course

, A collection of material, mostly papers on Distributed Systems Theory as well as seminal industry papers

, A comprehensive list of online courses related to distributed systems

Awesome Distributed Consensus

, Another list of materials on distributed consensus protocols

A blog post with some useful getting started links for distributed systems