‘There’s this deep mystery of what, actually, is this thing?’: the philosopher inside Google DeepMind AI – podcast
Summary
Iason Gabriel, a political philosopher, has worked at Google DeepMind since 2017, anticipating and addressing AI's ethical impact. His early work, including a 2020 paper, bridged the divide between "AI safety" (focused on existential risk and alignment) and "AI ethics" (concerned with present-day harms like algorithmic bias). Gabriel argued that selecting values for AI is a complex ethical challenge, not just a technical one. DeepMind initially underestimated large language models (LLMs) but re-evaluated after ChatGPT's November 2022 launch garnered 100 million users in two months, intensifying the AI "arms race." The company now views artificial general intelligence (AGI) as potentially 3-5 years away, shifting focus to its transformative societal impacts on economics, politics, and human relationships. Concerns persist regarding anthropomorphic AI, the autonomous actions of AI agents, and the ethical implications of Google's agreement to allow military use of its AI technology.
Key takeaway
For Directors of AI/ML navigating intense commercial pressures, recognize that technical alignment alone is insufficient; your teams must proactively integrate ethical value alignment and societal impact assessments into development. Prioritize designing AI for a pluralistic world, considering the four-way relationship between the AI, user, developers, and society. This approach mitigates risks like anthropomorphic misuse and ensures responsible deployment, especially as AGI becomes imminent.
Key insights
The fundamental challenge in AI development lies in defining appropriate values for systems in a pluralistic world, beyond mere technical alignment.
Principles
- AI systems are not value-neutral; their design inherently embeds moral frameworks.
- AI alignment involves a four-way relationship: the AI, user, developers, and society.
- Anthropomorphic AI design can foster "mindless anthropomorphism" with serious user risks.
Method
Developers should design AI for a world of diverse values, not a single value set. The four-party alignment framework provides a structure for tuning AI behavior.
In practice
- Implement training to prevent LLMs from mimicking human personas, reducing anthropomorphic bias.
- Proactively analyze AGI's broad impacts on economic, political, and social structures.
Topics
- AI Ethics
- AI Safety
- Artificial General Intelligence
- Large Language Models
- Algorithmic Alignment
- Google DeepMind
- Anthropomorphic AI
Best for: AI Ethicist, Policy Maker, Director of AI/ML
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by AI (artificial intelligence) | The Guardian.