The Age of Async Agents — Cognition's Walden Yan & OpenInspect's Cole Murray
Summary
The engineering world is rapidly shifting towards autonomous background agents, driven by advanced models like Opus 4.5 and GPT 5.2, which achieved significant capabilities around December 2025. This shift enables agents to autonomously drive tasks from specification to pull request with minimal human intervention, as demonstrated by Cognition's Devin, which saw a 7x increase in merged PRs and an 80% commit percentage in March from 16% in January. OpenInspect, an open-source project, emerged to address friction points in cloud-based agent sessions, particularly regarding context sharing. Key architectural decisions involve running the agent "in the box" versus "out of the box," with the latter, separating the agent's "brain" from the machine, preferred for security and infrastructure reuse despite its complexity. Managing the agent's working environment, including dependencies and credentials, remains a critical challenge.
Key takeaway
For AI Architects and MLOps Engineers designing or deploying autonomous coding agents, prioritize an "out-of-box" architecture that separates the agent's intelligence from its execution environment. This enhances security and allows for greater reuse of existing dev infrastructure. Focus on robust environment management and integrate agents deeply into your company's ecosystem, including read-only access to production systems and knowledge bases, to maximize their value for SRE, non-engineer contributions, and customer support.
Key insights
Autonomous background agents, powered by advanced models, demand robust infrastructure and careful architectural choices for security and scalability.
Principles
- Separate agent "brain" from machine for enhanced security.
- Optimize VM boot times using diff-based file systems.
- Local developer environments simplify agent setup and testing.
Method
The preferred agent architecture separates the agent's "brain" (control plane) from the sandbox environment, allowing the sandbox to act as "hands" for tool calls. This requires managing state externally but improves security and reusability.
In practice
- Deploy agents for SRE auto-triage and first-response scenarios.
- Enable non-technical roles (PMs, marketing) to initiate code changes.
- Integrate agents with production logs and databases for full visibility.
Topics
- Async Agents
- Cloud Agents
- Devin
- OpenInspect
- Agent Architecture
- VM Management
- SRE Automation
Best for: CTO, VP of Engineering/Data, Director of AI/ML, AI Engineer, MLOps Engineer, AI Architect
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Latent.Space - Www.latent.space.