😺 Watch: AI can do your taxes now
Summary
OpenAI, in collaboration with Thrive Holdings, developed Tax AI, a Codex-powered agent designed to streamline complex tax preparation workflows. Released on July 01, 2026, this system processes diverse data formats including PDFs, spreadsheets, and client notes to prepare tax returns for accountant review. A key innovation is its self-improvement loop: expert practitioners correct the agent's output, transforming these corrections into structured signals. Codex then investigates relevant traces and evaluations, enabling engineers to implement targeted fixes. This iterative process has resulted in processing 7,000 returns, saving a third of preparation time, and achieving approximately 97% draft accuracy, demonstrating how AI agents can integrate effectively into expert-driven tasks by learning from human feedback.
Key takeaway
For AI Engineers developing agents for expert workflows, prioritize building robust feedback loops over solely optimizing model performance. Your system must capture expert corrections as structured signals, enabling measurable product improvements and fostering trust. This "harness engineering" approach ensures agents get safer and more useful, transforming human review into continuous learning rather than lost effort, which is critical for high-stakes applications like tax preparation.
Key insights
AI agent reliability stems from structured expert feedback loops that transform corrections into measurable product improvements.
Principles
- Harness engineering drives agent improvement.
- Agents must provide source evidence.
- Expert corrections yield measurable signals.
Method
The method involves starting with bounded tasks, preserving evidence, capturing expert corrections as patterns, converting these into measurable evaluations, and integrating engineer review for scoped fixes.
In practice
- Prioritize building evaluation metrics.
- Capture user corrections as structured data.
- Implement source citation for AI outputs.
Topics
- OpenAI
- AI Agents
- Tax Preparation
- Codex Model
- Feedback Loops
- Harness Engineering
- Workflow Automation
Best for: Executive, AI Architect, Machine Learning Engineer, AI Engineer, MLOps Engineer, Director of AI/ML
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by The Neuron.