I keynoted alongside OpenAI and DeepMind
Summary
At the AI Engineer World's Fair, a system co-developed by Paul Iusztin and the author was presented, designed to transform thousands of personal notes into persistent, compounding agent memory. This "AI Research OS" manages close to 11,000 files from sources like Obsidian, Readwise, Notion, and Google Drive, enabling agents to leverage this knowledge without resetting context. The open-source system, available under an MIT license, utilizes Markdown, YAML, and folders, eschewing vector databases or knowledge graphs. It features a three-layer architecture: raw content, an index, and an LLM-maintained wiki layer that generates comparisons, concepts, and entities. The presentation detailed its evolution from V1 to V3, showcased four Claude Code skills, and included live demos. An associated workshop on "Context Engineering in 2026: Compaction, Memory & Cost" was also held on June 29 at Moscone West.
Key takeaway
For AI Engineers struggling with ephemeral agent context, this open-source AI Research OS offers a robust solution. You can build a personalized, compounding memory system using plain files and LLM-generated wikis, moving beyond traditional vector databases. Consider cloning the provided codebase and integrating your existing knowledge bases to create a more efficient, inspectable, and personalized research assistant that evolves with your interactions. This approach significantly reduces token consumption and context rebuilding overhead.
Key insights
A personalized AI research OS transforms personal notes into compounding agent memory via a file-based, LLM-maintained wiki.
Principles
- Agent context must compound across sessions.
- Token efficiency is key for agent memory.
- Personalization enhances AI system utility.
Method
Ingest diverse sources via a deep research algorithm into raw files. Catalog with index.yaml, then an LLM creates a wiki layer with derivatives for token-efficient querying.
In practice
- Clone the open-source AI Research OS.
- Install Claude Code skills for deep research.
- Integrate existing notes from Obsidian/Readwise.
Topics
- AI Research OS
- Agent Memory
- Context Management
- LLM Knowledge Bases
- Obsidian Integration
- Open-Source AI
Best for: AI Engineer, MLOps Engineer, AI Student
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Learn AI Together.