Turn 10,994 Notes Into Memory - Paul Iusztin, Decoding AI & Louis-François Bouchard, Towards AI
Summary
The AI Research OS, developed by Paul Iusztin and Louis-François Bouchard, is a personalized system designed to manage and utilize extensive research notes, addressing limitations of public LLMs for complex, evolving projects. This system, available as a GitHub repository, integrates personal knowledge bases from platforms like Obsidian, Readwise, NotebookLM, and GitHub. It employs a three-layer architecture: immutable raw files, a simple index.yaml cataloging data and summaries, and a dynamically evolving LLM-generated wiki. The wiki, which can be queried token-efficiently, creates derivatives like comparisons, concepts, and notes, and updates based on user interactions. The system prioritizes file-based storage for inspectability and aims to transform research into actionable work, supporting projects from articles to codebases.
Key takeaway
For AI Engineers building agentic systems or managing extensive research, consider implementing a personalized AI Research OS. This approach overcomes public LLM limitations by integrating your diverse knowledge sources into a dynamic, file-based wiki. You can utilize the provided GitHub repository and Cloud Code plugins to create a token-efficient, evolving knowledge base, ensuring your agents have consistent, personalized context for complex projects and avoiding repetitive context feeding.
Key insights
A personalized, file-based AI research OS dynamically manages and evolves knowledge from diverse sources for complex projects.
Principles
- Personal knowledge bases enhance AI agent context.
- File-based systems simplify personal research OS.
- Dynamic wikis evolve with user interaction.
Method
The system uses a three-layer architecture: raw files, an index.yaml catalog, and an LLM-generated wiki. Agents query the index, then source wiki pages, and finally raw sources for token-efficient information retrieval.
In practice
- Integrate Obsidian, Readwise, GitHub into a unified system.
- Use Cloud Code plugins for deep research and ingestion.
- Scope wikis to specific projects for focused work.
Topics
- AI Research OS
- Agentic AI Engineering
- Knowledge Management
- Context Management
- Obsidian Integration
- LLM Knowledge Bases
Best for: Machine Learning Engineer, AI Scientist, Research Scientist, AI Engineer, Software Engineer, AI Architect
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by AI Engineer.