Intelligence Is Pattern Matching With a Governor Bolted On
Summary
The article argues that intelligence, both natural and artificial, is primarily "pattern matching with a governor bolted on." It compares the evolutionary process that shaped biological competence, such as a frog's retina detecting flies, to the selection process in large language models (LLMs) where gradient descent filters for error reduction. This process results in opaque products despite transparent mechanisms, a phenomenon termed "computational irreducibility." While much of intelligence is associative pattern completion, the article identifies a "governor" as the critical component for higher cognition and creativity. This governor enforces consistency and entailment, allowing rejection of locally plausible but globally incoherent steps, distinguishing true simulation and creativity from mere hallucination or confident nonsense.
Key takeaway
For AI Scientists developing advanced models, understanding that true intelligence requires a "governor" beyond pure pattern matching is crucial. You should focus on integrating mechanisms that enforce consistency and entailment, allowing models to reject locally plausible but globally incoherent outputs. This approach helps distinguish genuine simulation and creativity from mere hallucination, pushing beyond simple autoregressive completion towards more robust and reliable AI systems.
Key insights
Intelligence is pattern matching governed by a mechanism that enforces consistency and rejects incoherence.
Principles
- Competence arises from selection, not explicit design.
- Opaque products result from filtered systems.
- Creativity requires informed transgression of norms.
In practice
- Distinguish creativity from hallucination by checking constraints.
- Recognize that expertise compiles knowledge for modeling.
- Implement mechanisms to enforce coherence in AI outputs.
Topics
- Pattern Matching
- Large Language Models
- Computational Irreducibility
- Cognitive Mechanisms
- AI Hallucination
- Creativity in AI
Best for: AI Scientist, Research Scientist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence on Medium.