Stop Regenerating AI Output. Start Correcting It.
Summary
The article advocates for a strategic shift from regenerating AI output to actively correcting it, emphasizing that AI models do not inherently learn from repeated errors like human juniors. The author, through experience summarizing sixty stakeholder interviews with ChatGPT, identified recurring issues like dropping exception cases, merging disagreements, and inventing defaults. Instead of repeatedly regenerating, the proposed method involves treating the first AI output as a draft, providing specific corrections, and documenting these in a workflow-specific "fix list." This list, when integrated into persistent AI contexts like Custom GPTs or Claude Projects, or used as an upfront prompt, transforms into an instruction set. This approach significantly reduces the number of iteration rounds, improving output quality and efficiency, as demonstrated by different fix lists for interview summaries versus status reports.
Key takeaway
For project managers or business analysts relying on AI for document generation, stop regenerating outputs and start actively correcting them. You should maintain workflow-specific "fix lists" detailing common AI errors, such as dropped exceptions or tone issues. Integrate these lists into your AI tools' persistent instructions or initial prompts. This approach will significantly reduce iteration rounds, ensuring more accurate and usable drafts from the first pass, transforming AI from a repetitive task into a compounding asset.
Key insights
Explicitly correcting AI output with a workflow-specific "fix list" is more effective than regeneration, as models don't self-correct.
Principles
- AI models require explicit, persistent correction for repeated errors.
- Always treat AI's initial output as a draft, not a final result.
- Workflow-specific "fix lists" improve AI output more than regeneration.
Method
The method involves four steps: 1) Treat the first output as a draft. 2) Correct specifically, naming failures. 3) Write down corrections in a workflow-specific fix list. 4) Integrate this list into the model's persistent instructions or initial prompt.
In practice
- Maintain a workflow-specific text file of common AI errors.
- Integrate this "fix list" into persistent AI instructions or pre-prompts.
Topics
- AI Prompt Engineering
- Large Language Models
- AI Workflow Optimization
- Custom GPTs
- Claude Projects
- AI Output Correction
Best for: Data Scientist, Software Engineer, Consultant
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence in Plain English - Medium.