Agents in Production: How OpenGov Built and Scaled OG Assist - Gabe De Mesa, OpenGov

· Source: AI Engineer · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Software Development & Engineering · Depth: Advanced, long

Summary

OpenGov has successfully built and scaled OG Assist, an AI agent system integrated across its ERP software products like budgeting, procurement, asset management, and permitting. OG Assist allows users to interact with an agent that makes tool calls against product data, and can even interpret and act on screen content. The system leverages an "Effect Native Agent Loop," moving from LangGraph, and relies heavily on the open-source TypeScript library Effect for structured concurrency, fine-grained control, tracing, and logging. Key architectural components include an Agent-to-Agent (A2A) protocol for defining agent routes, human-in-the-loop for tool call approvals, and sandboxing for safe code execution. OpenGov manages long context through rolling summarization and implements generative UI. Feedback collection via thumbs up/down and automated CI evals drive continuous improvement, while internal agents like Claude and Cursor enhance developer velocity.

Key takeaway

For AI Engineers building production-grade agent systems, prioritize full control over the agent loop and robust observability. You should adopt a structured framework like Effect for fine-grained control, tracing, and logging, ensuring debuggability and maintainability. Implement human-in-the-loop approvals and sandboxing for safety, especially with mutating operations or code execution. Integrate continuous feedback and automated evaluations to rapidly iterate and improve agent performance, accelerating your development and deployment cycles.

Key insights

OpenGov's OG Assist demonstrates a robust production AI agent architecture, emphasizing control, safety, and continuous improvement.

Principles

Method

OpenGov developed an "Effect Native Agent Loop" for full control, integrating structured concurrency, tracing, and logging. It uses rolling summarization for long context and sandboxing for agent code execution.

In practice

Topics

Best for: AI Engineer, Machine Learning Engineer, MLOps Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by AI Engineer.