Grounding vs. Compositionality: On the Non-Complementarity of Reasoning in Neuro-Symbolic Systems

· Source: Artificial Intelligence · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Emerging Technologies & Innovation · Depth: Expert, quick

Summary

A new study challenges the long-held assumption in neuro-symbolic AI that compositional reasoning emerges automatically from successful symbol grounding. Researchers introduce the Iterative Logic Tensor Network ($i$LTN), a fully differentiable architecture for multi-step deduction, to systematically disentangle the contributions of grounding and reasoning. Through a formal taxonomy of generalization, including novel entities, unseen relations, and complex rule compositions, the analysis demonstrates that models trained exclusively on a grounding objective fail to generalize. However, the full $i$LTN, when trained jointly on both perceptual grounding and multi-step reasoning, achieves high zero-shot accuracy across all tasks, providing empirical evidence that reasoning is a distinct capability requiring an explicit learning objective.

Key takeaway

For research scientists developing neuro-symbolic AI, you should re-evaluate system designs that rely solely on symbol grounding for compositional generalization. Your models will likely require explicit learning objectives for multi-step reasoning to achieve robust out-of-distribution performance. Consider architectures like the $i$LTN that allow for joint training of both grounding and reasoning components.

Key insights

Symbol grounding alone is insufficient for compositional generalization; explicit reasoning objectives are necessary.

Principles

Method

The Iterative Logic Tensor Network ($i$LTN) is a fully differentiable architecture for multi-step deduction, enabling joint training on perceptual grounding and reasoning objectives.

In practice

Topics

Best for: Research Scientist, AI Scientist, Machine Learning Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.