Vercel CEO Guillermo Rauch on the fight to split off models from agents
Summary
Vercel CEO Guillermo Rauch discusses the AI industry's shift from prototyping to production, highlighting Vercel's role as a central cloud infrastructure provider with 6 million daily deployments, half driven by coding agents, and over 1 trillion tokens flowing through its AI gateway daily. Rauch identifies coding agents and internal corporate agents as "killer apps," emphasizing the challenges of data security and audit trails in production. Vercel addresses these with its Eve framework for agent instructions and Vercel Sandbox for secure, policy-controlled agent execution. He notes a trend among clients moving away from single lab partners towards modular architectures, optimizing for price/performance with models like Gemini, DeepSeek, and GLM-5.2, and sees Vercel competing with major labs by advocating for open protocols.
Key takeaway
For MLOps Engineers deploying AI agents, recognize the critical shift from prototyping to secure production environments. You must prioritize solutions that offer granular data control and audit trails, like Vercel Sandbox, to mitigate risks of unauthorized data access or training on sensitive corporate codebases. Embrace modular AI architectures over coupled systems to optimize for price/performance and maintain flexibility with diverse models.
Key insights
The AI industry is shifting from prototyping to production, demanding secure, modular agent solutions and data control.
Principles
- Coding and internal corporate agents are the two "killer apps" driving AI adoption.
- Data control, audit trails, and access policies are critical for production-grade AI agents.
- SaaS models that "trap your data" are incompatible with the open nature required by agents.
Method
Vercel's Eve framework enables natural language instruction for agents, while Vercel Sandbox provides a secure, policy-controlled environment to execute agents and manage data access.
In practice
- Utilize sandboxing solutions to prevent agents from training on sensitive corporate codebases.
- Deploy internal agents to empower non-technical roles with real-time, secure data access.
- Evaluate models like Gemini, DeepSeek, and GLM-5.2 for optimal price/performance in production.
Topics
- Vercel
- AI Agents
- MLOps
- Data Security
- Cloud Deployment
- LLM Performance
- Modular AI Architecture
Best for: CTO, VP of Engineering/Data, AI Architect, AI Engineer, MLOps Engineer, Director of AI/ML
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by TechCrunch.