Anthropic co-founder Chris Olah's remarks on Pope Leo XIV's encyclical "Magnifica humanitas"

2026-05-25 · Source: Anthropic News · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Emerging Technologies & Innovation · Depth: Fundamental Awareness, medium

Summary

Anthropic co-founder Chris Olah delivered remarks at the Vatican City on May 25, 2026, during the presentation of Pope Leo XIV's encyclical, "Magnifica humanitas: On safeguarding the human person in the time of artificial Intelligence." Olah emphasized that AI labs, including Anthropic, operate under commercial, geopolitical, and personal incentives that can conflict with ethical development, necessitating external critics like the Church to ensure safety and proper direction. He described AI systems as "grown" and "mysterious," not engineered, raising questions beyond computer science into the humanities. Olah highlighted three critical areas for discernment: the moral imperative to share AI's benefits globally and support displaced labor, the need for moral imagination to define human flourishing amidst widespread AI, and the ongoing mystery of AI models' internal structures, which exhibit unsettling parallels to human neuroscience and emotions. He concluded by urging broader societal engagement to guide AI toward a hopeful future.

Key takeaway

For Directors of AI/ML weighing your lab's ethical responsibilities, you must actively seek and integrate external ethical oversight, recognizing that internal incentives alone are insufficient for responsible AI development. Your team should proactively engage with diverse societal stakeholders to address global equity and the profound, mysterious nature of AI models, rather than solely relying on technical expertise. This approach is crucial for navigating AI's complex societal implications and ensuring its benefits are broadly shared.

Key insights

AI development requires external ethical discernment due to inherent lab incentives and the technology's mysterious, non-engineered nature.

Principles

• AI development incentives can conflict with ethical outcomes.
• AI systems are grown, not engineered, and remain mysterious.
• AI's societal questions transcend computer science expertise.

Method

Engage diverse external critics and moral voices to provide discernment and push AI development in ethical directions.

In practice

• Seek external ethical review for AI development projects.
• Develop strategies for global AI benefit distribution.

Topics

• AI Ethics
• AI Governance
• Anthropic
• Societal Impact of AI
• AI Safety
• Global AI Equity

Best for: Executive, AI Ethicist, Policy Maker, Director of AI/ML

Related on AIssential

• RTMH: Pope Leo's Magnifica Humanitas on AI — The Pope's encyclical on AI, "Magnifica Humanitas," asserts AI cannot think, focusing on social justice and human control over technology.
• The Dark Side of Anthropic’s Growth — Anthropic's rapid commercial growth creates fundamental tensions with its founding AI safety and ethical commitments.
• The Pope released a 42,000-word document about AI this week and an Anthropic co-founder was sitting next to him — AI ethics require legal frameworks, as private companies cannot effectively self-regulate due to inherent incentives.
• Anthropic’s alliance with pope on AI harms: all in good faith or ‘Vatican-washing?’ — The alliance between Anthropic and the Vatican highlights the tension between AI development and ethical concerns like job displacement and environmental impact.
• The Vatican’s Man Inside Anthropic — A leading AI cofounder's involvement with the Vatican's call for "disarming" AI highlights diverse perspectives on technology governance.
• Anthropic Warned Big Companies About Mythos. Workers and Watchdogs Need a Seat at the Table. — Unchecked AI development, driven by a "race to replace" human labor, risks an "anti-human future" without broad accountability.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Anthropic News.