Podcast: Increasing Users' Data Agency: From BlueSky's AT Protocol to the Local-First Software Movement
Summary
Martin Kleppmann, an associate professor at Cambridge and author of "Designing Data-Intensive Applications", discusses the evolution of data systems, highlighting a decade-long shift from monolithic databases to modular, cloud-native architectures utilizing inherently replicated object stores. He advocates for decentralized data storage, exemplified by Bluesky's AT Protocol, which prioritizes user data portability and a consistent user experience over purely federated models like ActivityPub. Kleppmann also details the local-first software movement, emphasizing user agency by storing primary data copies on client devices to enable offline access, improve speed, and mitigate vendor lock-in. The open-source Rust library Automerge is presented as a key enabler for building local-first collaborative applications, offering Git-like version control for diverse data formats, including spreadsheets and CAD files.
Key takeaway
For AI Architects and Data Engineers designing new systems, prioritize user data agency and resilience against vendor lock-in by adopting decentralized and local-first principles. Consider modular data stacks leveraging object stores and protocols like AT Protocol for federated services, ensuring user data portability. Explore libraries such as Automerge to build collaborative applications where primary data resides client-side, offering offline capabilities and robust version control for diverse data types, thereby enhancing user control and system robustness.
Key insights
Data agency is enhanced by shifting from cloud-centric monoliths to decentralized, local-first architectures.
Principles
- Decouple data storage from compute in cloud-native designs.
- Prioritize user agency through local data copies.
- Design protocols for data portability between providers.
Method
Implement local-first principles by ensuring the primary data copy resides on the client device, enabling offline access and reducing reliance on continuous cloud connectivity.
In practice
- Evaluate AT Protocol for decentralized social media applications.
- Use Automerge library for local-first collaboration features.
- Apply Git-like version control to non-textual data formats.
Topics
- Data Agency
- Decentralized Systems
- Local-First Software
- AT Protocol
- Cloud-Native Architecture
- Automerge Library
- Distributed Systems
Best for: CTO, VP of Engineering/Data, Product Manager, Software Engineer, Data Engineer, AI Architect
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by InfoQ.