Giving AI the capacity for judgment
Summary
AI systems currently lack reliable judgment because they are primarily prediction machines with a narrow scope of perception, failing to consider important, often intangible, human factors like legal ramifications, public reception, moral intuitions, or employee ennui. This limitation stems from the difficulty of encoding nuanced human values and causal links into training data or reward functions, as exemplified by challenges in the trolley problem or predicting election outcomes. The article argues that human judgment transcends AI by integrating perception, prediction, and value assessment into a single, unified process driven by evolving motives and embodied experiences. This allows humans to dynamically define new "objects" and reward systems, adapting their understanding of the world to achieve goals rather than relying on predefined, static categories, a flexibility AI currently lacks due to its reliance on explicit, fixed data structures and historical data.
Key takeaway
For AI Researchers and Engineers aiming to develop more capable AI, you should prioritize integrating dynamic, motive-driven learning into your models. Moving beyond static prediction to systems that can invent new ways of perceiving the world and defining value, based on embodied experiences and evolving needs, will be crucial for achieving human-like judgment and adaptability. Consider how your AI can learn to define its own "objects" and causal relationships through active intervention, rather than relying solely on predefined datasets.
Key insights
Human judgment integrates perception, prediction, and value assessment dynamically, allowing for adaptive, motive-driven understanding beyond AI's fixed scope.
Principles
- Prediction alone is insufficient for good judgment.
- Causal links connect prediction to useful judgment.
- Motives drive the definition of perceived objects and rewards.
Method
The proposed method collapses perception, prediction, and value assessment into a single "judgment" step, where the mind interprets the world based on affordances causally useful for achieving goals, then acts.
In practice
- AI systems need dynamic ontology creation.
- Focus AI development on causal inference, not just correlation.
- Integrate embodied interaction for causal learning.
Topics
- AI Judgment
- Human Intuition
- Causal Reasoning
- Embodied Cognition
- Value-Driven AI
Best for: AI Researcher, AI Engineer, Data Scientist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by AI Advances - Medium.