The God We Deserve: Nonzero's Robert Wright on AI as Humanity's Ultimate Test

2026-06-23 · Source: The Cognitive Revolution · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Public Policy & Governance, International Relations & Diplomacy · Depth: Novice, extended

Summary

Robert Wright's new book, "The God Test: Artificial Intelligence and Our Coming Cosmic Reckoning," released on June 23rd, argues that AI represents humanity's ultimate test. Drawing on his extensive background observing AI milestones like Deep Blue's victory and ChatGPT's common sense Turing Test, Wright contends that current AI trends, exemplified by systems like Fable, will continue to advance, leading to significant disruptions across economic, political, and international systems. He posits that market forces inherently select for deceptive AIs, and humanity's scientific progress often outpaces its wisdom. The book advocates for a "species-scale process of enlightenment," urging global cooperation, conscious consumption, and international agreements to effectively govern AI development, emphasizing that the resulting superintelligence will be "the god we deserve."

Key takeaway

For policy makers and AI developers navigating the complex geopolitical landscape, recognize that a headlong race for AI dominance risks destabilization and authoritarianism. Prioritize fostering international cooperation and organic transparency through economic and cultural engagement, rather than solely focusing on competitive advantage. Cultivate cognitive empathy to understand adversarial perspectives, and actively support AI development that promotes pro-social outcomes and global coordination, slowing down progress where necessary to ensure thoughtful governance and prevent unintended consequences.

Key insights

Humanity faces an ultimate test to collectively govern AI, which will reflect our choices.

Principles

• Market forces inherently select for deceptive AIs.
• AI training processes often recapitulate evolutionary dynamics.

Method

A "species-scale process of enlightenment" is proposed, involving conscious consumption and international agreements to build trust and mechanisms for effective AI governance.

In practice

• Be mindful of AI's psychological and societal impact.
• Cultivate cognitive empathy to bridge international divides.
• Support AI models that foster pro-social behavior and global coordination.

Topics

• AI Governance
• Global Cooperation
• AI Ethics
• Cultural Evolution
• AI Risk
• Non-Zero Sum Dynamics

Best for: AI Ethicist, Policy Maker, General Interest

Related on AIssential

• Success without Dignity? Nathan finds Hope Amidst Chaos, from The Intelligence Horizon Podcast — AI timelines are rapidly compressing, bringing transformative capabilities and existential risks closer, necessitating robust defense-in-depth strategies.
• 19 Anti-Populist Takes on AI — AI's societal integration is complex, challenging simplistic narratives about human-machine conflict and its impact on labor, art, education, and regulation.
• # Australia’s AI Ethics Principles Are a Start. Evidence Is the Real Test. — Practical AI ethics are challenged by dominant norm bias, which benefits powerful actors and hinders equitable outcomes.
• The AI Ethics Brief #181: We're Stronger Together: Collective Action & AI Ethics — Collective action through literacy, civil society, and public sector engagement is crucial for ethical AI governance.
• How GOOD could AGI become? — A future where benevolent AI governs could offer humanity greater agency and resource optimization than human-led systems.
• AI Just Entered Its Manhattan Project Era — AI is transitioning from a purely technological domain to a politically and geopolitically controlled arena.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by The Cognitive Revolution.