分散システム基礎キット
基礎ブロックを学ぶ:見積もり、一意ID、レジリエンス、KVストア、キャッシュ、ロックと合意、メッセージキュー、ストリーム処理、CDC、永続ワークフロー。
学習
Back-of-Envelope Estimation and Capacity Model Template
フルReference latency and unit tables, assumptions register, QPS, storage, bandwidth, cache, server and cost formulas, worked example, sensitivity, traceability
Jeff Dean latency numbers (LADIS 2009)Distributed Unique ID Generator System Design Template
フルUUIDv4 and v7 per RFC 9562, Snowflake 41/10/12 layout, clock skew and backwards clocks, leased worker IDs, index locality, 53-bit JS limit, ticket servers
RFC 9562 (May 2024)Resilience and Load Shedding Design Template (Retries, Circuit Breakers)
フルFailure model, deadlines, retries with jitter and budgets, circuit breakers, bulkheads, backpressure, criticality-based shedding, degradation, fault tests
Google SRE book ch. 21-22; Amazon Builders' Library
参照設計
Distributed Key-Value Store System Design Template (Dynamo-Style)
フルConsistent hashing, vnodes, quorums (R+W>N), vector clocks vs LWW, hinted handoff, Merkle anti-entropy, gossip, LSM compaction, cache eviction, hot keys
Dynamo (DeCandia et al., SOSP 2007)Distributed Cache System Design Template
フルDistributed cache: cache-aside, delete on write, leases against herds, commit-log invalidation across regions, slot maps, hot keys, gutter pool, warm-up
Distributed Lock and Coordination System Design Template
フルLock and coordination service: Raft consensus, read index, sessions and keep-alives, leader election, fencing tokens, watches, read scaling, misuse policy
Distributed Message Queue System Design Template (Kafka-Style Log)
フルPartitions, log segments, retention, acks and idempotence, consumer groups, offsets, delivery semantics, ordering, ISR replication, backpressure, DLQ, schemas
Apache Kafka 4.3 documentation; Kafka paper (NetDB 2011)Stream Processing Engine System Design Template
フルStream processing engine: event time, watermarks, windows and triggers, late data, keyed state, barrier checkpoints, exactly-once sinks, backpressure, rescaling
CDC Pipeline System Design Template
フルCDC pipeline: log-based capture, watermark chunked snapshot, per-key order, schema evolution, outbox, search, cache and warehouse sinks, replay
Workflow Orchestration Engine System Design Template
フルDurable workflow engine design: event history and replay, deterministic code, activities, timers, task queues, retries, versioning, visibility, history sharding