Artificial intelligence raises profound moral questions — for all of humanity to answer

2026-06-16 · Source: Artificial intelligence (AI) – The Conversation · Field: Technology & Digital — Artificial Intelligence & Machine Learning, AI Governance & Ethics · Depth: Novice, long

Summary

The article highlights the urgent need for independent regulation and public involvement in setting moral standards for artificial intelligence, arguing that critical ethical decisions should not be left to AI developers and corporations alone. This call is reinforced by Pope Leo XIV's encyclical "Magnifica Humanitas" and Anthropic co-founder Chris Olah, who stated his industry "cannot be trusted to govern itself." The piece draws parallels to the regulation of pharmaceuticals and nuclear power, where independent bodies ensure safety. It criticizes current "participation-washing" efforts, where public input lacks real power, and points out that even advanced governance tools like Canada's Directive on Automated Decision-Making and Algorithmic Impact Assessment still rely on technical experts rather than broad public moral judgment. The article advocates for democratic moral governance, emphasizing that while AI presents unique challenges like rapid innovation and diverse applications, discrete decisions on model release or deployment in sensitive areas can be regulated, potentially through international oversight like the UN's Global Dialogue on AI Governance.

Key takeaway

For policy makers developing AI governance frameworks, you must prioritize establishing independent regulatory bodies with genuine veto power over AI deployment. Your efforts should move beyond mere consultation, ensuring public participation translates into substantive decision-making authority for setting moral standards. Avoid "participation-washing" by empowering citizens to shape AI's ethical boundaries, mirroring oversight models for pharmaceuticals or nuclear power.

Key insights

AI's profound moral questions necessitate independent regulation and democratic public governance, not corporate self-regulation or "participation-washing."

Principles

• AI's moral choices require external oversight.
• Independent regulators must have veto authority.
• Public input needs substantive decision power.

Method

Establish independent regulators empowered to approve or reject AI deployments, guided by moral standards set through broad public participation. Implement rolling reviews for discrete AI decisions and foster international oversight mechanisms.

In practice

• Implement citizens' assemblies for AI policy.
• Scrutinize AI deployment in sensitive sectors.
• Support international AI governance dialogues.

Topics

• AI Governance
• Independent Regulation
• Public Participation
• AI Ethics
• Algorithmic Impact Assessment
• Constitutional AI

Best for: Policy Maker, AI Ethicist, Director of AI/ML

Related on AIssential

• The Pope released a 42,000-word document about AI this week and an Anthropic co-founder was sitting next to him — AI ethics require legal frameworks, as private companies cannot effectively self-regulate due to inherent incentives.
• Democracy in the Era of Artificial Intelligence — AI's impact on democracy is design-dependent, offering opportunities to upgrade systems if guided by democratic principles.
• I’m on the Meta Oversight Board. We need AI protections now | Suzanne Nossel — Independent oversight is crucial for AI accountability, bridging the gap until government regulation can catch up.
• The Machine Ethics podcast: moral agents with Jen Semler — Consciousness is not a necessary condition for an AI system to possess moral agency.
• Silicon Valley's Moral Posturing Is an AI Power Play — Silicon Valley's shift to moral posturing in AI debates reflects declining public trust and a struggle for control over technology's ethical direction.
• Digital monitoring is growing in South Africa’s public service – regulation needs to catch up — Rapid digital tool adoption in public sector evaluation outpaces ethical governance, creating risks for citizens and data integrity.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial intelligence (AI) – The Conversation.