Fable 5 just set a new AI freelance work performance record - but it can't replace humans yet
Summary
Anthropic's Fable 5 model, re-authorized by the US government on June 30, has set a new performance record on the Center for AI Safety's (CAIS) Remote Labor Index (RLI). Tested before its brief hiatus, Fable 5 achieved a 16.1% automation rate, successfully completing "economically valuable freelance projects" at a client-acceptable quality. This significantly surpasses previous leaders, including Anthropic's Opus 4.8 (8.3%) and OpenAI's GPT-5.5 (6.3%), and more than doubles the prior record of 4.17% (Opus 4.6) from October 2025. CAIS noted that the frontier has "quadrupled in under eight months." Despite this rapid advancement, the 16.1% rate indicates AI cannot yet fully replace human freelancers, with an "LLM judge" failing to evaluate RLI deliverables, highlighting current AI limitations in complex computer-use skills.
Key takeaway
For AI Product Managers evaluating agentic model integration, recognize that while Fable 5's 16.1% automation rate is a significant leap, it underscores the continued necessity of human oversight for quality assurance. Your strategy should prioritize hybrid workflows where AI augments, rather than fully replaces, human freelancers, especially for tasks requiring nuanced computer-use skills. Plan for robust human-in-the-loop processes to validate AI outputs and address security concerns during adoption.
Key insights
AI agent performance on freelance tasks has quadrupled in eight months, but human oversight remains critical.
Principles
- AI automation rates are rapidly accelerating.
- Complex computer-use skills limit current AI agents.
- Human evaluation is essential for quality assessment.
Method
The Remote Labor Index (RLI) evaluates AI agents by having human evaluators assess AI-generated freelance project deliverables against professional standards, using human-generated input files.
In practice
- Benchmark AI agents using human-evaluated RLI.
- Focus AI development on complex computer-use skills.
- Integrate human oversight for AI-generated work.
Topics
- Fable 5
- AI Agents
- Remote Labor Index
- Automation Rates
- Freelance Work
- AI Benchmarking
- Anthropic
Best for: Director of AI/ML, AI Product Manager, Tech Journalist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by News and Advice on the World's Latest Innovations | ZDNET.