CI/CD Is Dead, Agents Need Continuous Compute and Computers — Hugo Santos and Madison Faulkner
Summary
Madison, a partner at NEA, and Hugo Santos, CEO of Namespace, propose that traditional CI/CD pipelines are becoming obsolete due to the rise of agentic software, advocating for a "continuous compute" paradigm. They highlight that while human developers submit few pull requests (PRs) weekly, AI agents generate thousands of short-lived branches and PRs, overwhelming current CI/CD systems and making merges impossible. The proposed solution involves accelerating build, test, and deploy times through hardware/software co-design, with caching becoming an orchestration layer. This new architecture eliminates PRs, starting with an "intent and plan" that agents continuously validate internally. The future vision includes fully automated external validation by specialized agents (e.g., security LLMs) and a "pre-merge queue" to reconcile numerous parallel changes before human approval of the intent and result, not individual code.
Key takeaway
For CTOs and VPs of Engineering grappling with scaling development in an AI-driven landscape, your current CI/CD infrastructure will soon be a bottleneck. You should prioritize investing in continuous compute solutions that support agentic workflows, focusing on accelerating internal validation and exploring agent-driven external validation to manage the exponential increase in code changes. This shift will enable your teams to maintain velocity and control as agentic software adoption grows.
Key insights
Agentic software's high-volume, continuous code generation necessitates a shift from traditional CI/CD to continuous compute.
Principles
- Code generation is cheap, continuous, and requires inner-loop evaluation.
- Time to merge is critical, akin to high-performance database serialization.
- CI principles shift from separate phases to continuous, in-loop validation.
Method
A new architecture replaces PRs with an "intent and plan" that agents continuously validate internally. External validation shifts to specialized agents, with a pre-merge queue for human approval of results.
In practice
- Implement hardware/software co-design for faster build/test/deploy.
- Utilize agentic identity for software and retries at scale.
- Employ a stateful environment for agentic loops to avoid delays.
Topics
- Agentic Software Development
- Continuous Compute
- CI/CD Transformation
- Pre-Merge Queues
- LLM-driven Automation
Best for: CTO, VP of Engineering/Data, Director of AI/ML, MLOps Engineer, AI Engineer, AI Architect
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by AI Engineer.