My Agentic Workbench

· Source: LLM on Medium · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Software Development & Engineering · Depth: Advanced, long

Summary

An "Agentic Workbench" developed over six months enables building software primarily with AI agents like Claude 4.5, minimizing manual code writing. This workbench comprises small, specialized open-source tools such as dossier for project memory, ship for task execution, rooms for isolated command execution in Firecracker microVMs, huddle for agent communication, and sense for output grading. The author positions the large language model (LLM) as the orchestrator, with tools designed to support its operations. The workflow involves planning tasks in dossier, preparing batches, and driving execution through ship, with agents handling code generation and review. The system integrates agent-based testing and a "review-coordinator" agent to consolidate feedback from multiple AI reviewers (Copilot, Codex, Claude, Cursor's Bugbot), aiming to reduce human intervention. A core principle is "embracing the slop," tolerating minor stylistic differences in agent-generated code if functionality and reliability are met.

Key takeaway

For AI Engineers building agentic systems, you should shift your focus from writing code to designing robust orchestration and validation layers. Embrace small, specialized tools that empower the LLM as the primary orchestrator, rather than trying to out-build it. Implement agent-on-agent testing and review coordination to ensure confidence in automated outputs, allowing you to tolerate minor stylistic "slop" and accelerate development velocity. Your role evolves to confidence-checking and system design.

Key insights

Building with AI agents requires small, sharp tools and a system-centric approach to orchestration, testing, and review.

Principles

Method

Plan tasks in dossier, prep batches, drive execution via ship, review with multiple agents and a /review-coordinator, then recap. Automate repetitive agent actions into code.

In practice

Topics

Code references

Best for: AI Engineer, Machine Learning Engineer, Software Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by LLM on Medium.