The mistake of conflating intelligence and power

2025-06-02 · Source: Dwarkesh Podcast · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Emerging Technologies & Innovation · Depth: Novice, quick

Summary

The article discusses the common mistake of conflating intelligence with power, particularly in the context of Artificial Superintelligence (ASI). It defines intelligence as the "ability to achieve your goals across a wide range of domains" but notes this definition can lead to equating intelligence with power, as seen with figures like Donald Trump, Xi Jinping, Vladimir Putin, or Stalin. It contrasts this with an alternative definition focusing on manipulating abstract concepts, which doesn't correlate strongly with real-world power. The author argues that real-world power stems from authority and trust, enabling collaboration, rather than individual "galaxy brain scheming." The piece suggests that "automated firms" will outcompete others through capitalist mechanisms, rather than a single AI outthinking everyone, drawing parallels to how collective intelligence (like national IQ) drives societal outcomes more than individual genius.

Key takeaway

For AI strategists evaluating future AI impacts, recognize that advanced AI's "intelligence" in problem-solving doesn't automatically translate to real-world power. Focus on how AI systems integrate into existing social and economic structures, enabling "automated firms" to gain competitive advantage through collaboration and trust, rather than assuming a singular, all-powerful AI entity. Your risk assessments should account for systemic shifts, not just individual AI capabilities.

Key insights

Conflating intelligence with power is a common error, especially when considering advanced AI.

Principles

• Real-world power derives from authority and trust, not just individual intellect.
• Collective intelligence drives societal outcomes more than individual genius.
• Automated firms will compete via capitalist means, not singular AI dominance.

Topics

• Artificial General Intelligence
• AI Ethics
• Power Dynamics
• Organizational Intelligence
• Economic Competition
• AI Strategy

Best for: AI Ethicist, Consultant, General Interest

Related on AIssential

• AI might make us dumber, but it will make companies a lot smarter — AI enables firms to compound institutional knowledge, creating a first-mover advantage unlike previous tech shifts.
• The "AI will automate all white collar work" crowd has a serious blind spot — Claims of imminent, mass white-collar AI automation ignore economic realities, social consequences, and the actual business models of AI companies.
• Lutnick’s Anthropic Crackdown Claims New Power Over AI Models — Lutnick's asserted control over Anthropic's AI models signals shifting power dynamics in the AI sector.
• The AI Race Is Winner-Take-All — AI drives a "flywheel effect" in both civilian economies and military contexts, accelerating growth and competition.
• A Whimper, Not a Bang — The future of AI will be defined by restricted access and concentrated power, not universal capability.
• Schrödinger’s Apocalypse — Human preferences and the "possibility of exception" are critical, often overlooked, market forces shaping AI's economic impact.

See Counsel's argued verdicts on the open AI decisions leaders are weighing →

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Dwarkesh Podcast.