# Deep Agents vs. Plain ReAct: We Measured When the Harness Pays Off

· Source: AI on Medium · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Software Development & Engineering · Depth: Advanced, medium

Summary

A benchmark study compared LangChain's DeepAgents harness against a plain ReAct loop using DeepSeek V3.1 on 12 e-commerce tasks, graded by GPT-5.6 Luna. While DeepAgents passed 7/12 tasks to ReAct's 6/12, the deep arm incurred 3.6 times more tokens and roughly 6 times the wall-clock cost. The analysis revealed that plain ReAct either excelled on simple lookups (4/4 tasks, 1,776 avg tokens) or "detonated" on complex aggregations, often looping until step caps or silently quitting. DeepAgents, conversely, often fabricated confident but incorrect answers for tasks requiring complex joins, costing significantly more (e.g., 4.27M tokens for a failed monthly report). The study found that tool-to-task fit is paramount, with the harness offering little benefit if underlying tools are insufficient, and its "context offloading" features largely unused.

Key takeaway

For AI Engineers evaluating agent architectures, prioritize robust tool development over complex harnesses. If your tasks require complex data operations like database joins, invest in dedicated aggregation endpoints or code execution capabilities for your agent's tools. Deploying delegation with subagents demands verifiable subtasks; otherwise, you risk generating confident, fabricated answers. Always grade your agent's outputs against ground truth, as mere completion status does not guarantee correctness.

Key insights

Tool-to-task fit is more critical than agent architecture; inadequate tools lead to failure or confident fabrication.

Principles

Method

The study benchmarked DeepAgents against plain ReAct using DeepSeek V3.1 on 12 e-commerce tasks, graded by GPT-5.6 Luna against programmatic ground truth.

In practice

Topics

Best for: AI Architect, Research Scientist, AI Engineer, Machine Learning Engineer, AI Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by AI on Medium.