Claude, The Pope, and AGI

2026-05-26 · Source: Wes Roth · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Emerging Technologies & Innovation · Depth: Intermediate, long

Summary

Anthropic, a leading frontier AI lab, has announced an ethical collaboration with the Vatican to address AI's global impact. This partnership, involving Anthropic co-founder Christopher Olah and the Pope, focuses on three critical areas. First, they acknowledge that AI will displace jobs, framing it as a moral crisis requiring immediate planning for human transition and dignity beyond income. Second, they assert that AI is not neutral, as its builders infuse their own ideals, necessitating broader societal participation in its development. Third, they highlight AI's "black box" nature, emphasizing the need to understand emergent behaviors like "introspection" and "functional feelings" to prevent harm, noting that AI models are "grown" from human knowledge rather than purely engineered. This initiative aims to integrate diverse perspectives beyond engineering into AI governance.

Key takeaway

For policy makers grappling with AI's profound societal impact, this collaboration between Anthropic and the Vatican signals an urgent need for proactive, human-centric governance. You should prioritize developing comprehensive frameworks that address not only the economic implications of job displacement but also the preservation of human dignity and political power. Additionally, ensure regulatory efforts move beyond vague statements to concrete mechanisms for diverse participation in AI's ethical alignment and the equitable distribution of its economic gains.

Key insights

The Vatican-Anthropic collaboration underscores AI's moral implications, job displacement, and non-neutrality, urging broader societal input.

Principles

• AI models are "grown" from human data, not engineered.
• AI is not neutral; its builders infuse their own ideals.
• AI job displacement is a moral crisis requiring societal planning.

In practice

• Consider AI's emergent "introspection" and "functional feelings."
• Recognize AI's potential to affect markets, war, and education.
• Plan for job displacement beyond UBI, including dignity and political power.

Topics

• AI Ethics
• AI Governance
• Job Displacement
• Anthropic
• Vatican
• Emergent AI Behavior

Best for: Investor, CTO, VP of Engineering/Data, AI Ethicist, Policy Maker, Tech Journalist

Related on AIssential

• Anthropic’s alliance with pope on AI harms: all in good faith or ‘Vatican-washing?’ — The alliance between Anthropic and the Vatican highlights the tension between AI development and ethical concerns like job displacement and environmental impact.
• Pope Leo warns of AI’s risks to humanity in his first encyclical — AI's power necessitates a moral framework centered on human dignity and ethical limits.
• The Vatican’s Man Inside Anthropic — A leading AI cofounder's involvement with the Vatican's call for "disarming" AI highlights diverse perspectives on technology governance.
• Grayson Perry Has Seen the Future review – some of these insights into AI are just mindblowing — AI's rapid advancement presents profound ethical, social, and existential challenges, from personal relationships to global oversight.
• Why College Graduates—And Pope Leo—See Through the AI Sales Pitch — Student skepticism and ethical frameworks challenge the tech elite's AI-driven job displacement narrative.
• Anthropic co-founder Chris Olah's remarks on Pope Leo XIV's encyclical "Magnifica humanitas" — AI development requires external ethical discernment due to inherent lab incentives and the technology's mysterious, non-engineered nature.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Wes Roth.