Agents Don't Do Standups: Building the Post-Engineer Engineering Org — Mike Spitz, PFF
Summary
PFF, a sports data company serving NFL/NCAA teams and consumers, implemented an AI-driven engineering workflow case study from January to March, involving two top engineers. The initiative aimed to accelerate agent output rather than individual engineer productivity, addressing a bottleneck in their 20-engineer, fully distributed team. This new approach resulted in a 25x increase in deploys, with the two engineers deploying five times daily compared to the larger team's one deploy every five days. Furthermore, their output, measured by blended tickets and code complexity, saw a 10x improvement. The project delivered features in under two months, halving previous four-month estimates, and significantly boosted customer satisfaction scores from an average of 7-7.5 to 8.6 out of 10, indicating a better alignment with customer interests.
Key takeaway
For Directors of AI/ML or AI Architects seeking to accelerate development cycles and improve product delivery, consider a phased adoption of AI agents in your engineering workflow. Focus on automating deterministic, repetitive tasks and integrating agents into design and review processes. This can significantly reduce time-to-market and enhance customer satisfaction, but ensure guardrails are functional and start with your most knowledgeable engineers in non-critical areas.
Key insights
AI-driven engineering workflows can drastically increase deployment frequency and output while improving customer satisfaction.
Principles
- Optimize for agent speed, not just engineer output.
- Customer satisfaction is the ultimate metric for engineering success.
- Automate repetitive tasks to free engineers for complex work.
Method
The process involves huddles for instant feedback, agent-driven spec interviews, lightweight design documents (LDDs), automated ticket/PR creation, and agentic code reviews for style and variable names, replacing traditional Scrum ceremonies.
In practice
- Start AI adoption with non-critical systems.
- Automate QA and aim for self-healing agents.
- Encode organizational coding patterns into composable AI skills.
Topics
- Post-Engineer Engineering Org
- AI Agents
- Automated Software Development
- Lightweight Design Documents
- Agentic Code Review
Best for: Director of AI/ML, AI Architect, Software Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by AI Engineer.