Grounding vs. Compositionality: On the Non-Complementarity of Reasoning in Neuro-Symbolic Systems
Summary
A new study challenges the long-held assumption in neuro-symbolic AI that compositional reasoning emerges automatically from successful symbol grounding. Researchers introduce the Iterative Logic Tensor Network ($i$LTN), a fully differentiable architecture for multi-step deduction, to systematically disentangle the contributions of grounding and reasoning. Through a formal taxonomy of generalization, including novel entities, unseen relations, and complex rule compositions, the analysis demonstrates that models trained exclusively on a grounding objective fail to generalize. However, the full $i$LTN, when trained jointly on both perceptual grounding and multi-step reasoning, achieves high zero-shot accuracy across all tasks, providing empirical evidence that reasoning is a distinct capability requiring an explicit learning objective.
Key takeaway
For research scientists developing neuro-symbolic AI, you should re-evaluate system designs that rely solely on symbol grounding for compositional generalization. Your models will likely require explicit learning objectives for multi-step reasoning to achieve robust out-of-distribution performance. Consider architectures like the $i$LTN that allow for joint training of both grounding and reasoning components.
Key insights
Symbol grounding alone is insufficient for compositional generalization; explicit reasoning objectives are necessary.
Principles
- Reasoning is a distinct, non-emergent capability.
- Grounding and reasoning are not complementary.
Method
The Iterative Logic Tensor Network ($i$LTN) is a fully differentiable architecture for multi-step deduction, enabling joint training on perceptual grounding and reasoning objectives.
In practice
- Train neuro-symbolic systems with explicit reasoning objectives.
- Use $i$LTN for multi-step deduction tasks.
Topics
- Neuro-Symbolic Systems
- Compositional Generalization
- Symbol Grounding
- Iterative Logic Tensor Network
- Multi-step Deduction
Best for: Research Scientist, AI Scientist, Machine Learning Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.