InfoQ: How Fly.io Replicates SQLite Globally in less than 1 Second

Fly.io ditched HashiCorp's Consul for global SQLite replication because it just couldn't handle scaling to 800+ nodes. So, they rolled their own: "Corrosion," a distributed, eventually consistent state engine built with Rust and SQLite.

Corrosion brilliantly uses CRDTs (Conflict-free Replicated Data Types) and the SWIM gossip protocol to keep machine states in sync globally. This lets them avoid bottlenecks of a central leader, achieving sub-second replication while balancing distributed system challenges like the CAP theorem!

Watch on YouTube