‘There’s this deep mystery of what, actually, is this thing?’: the philosopher inside Google DeepMind AI – podcast

· Source: AI (artificial intelligence) | The Guardian · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Emerging Technologies & Innovation · Depth: Intermediate, extended

Summary

Iason Gabriel, a political philosopher, has worked at Google DeepMind since 2017, anticipating and addressing AI's ethical impact. His early work, including a 2020 paper, bridged the divide between "AI safety" (focused on existential risk and alignment) and "AI ethics" (concerned with present-day harms like algorithmic bias). Gabriel argued that selecting values for AI is a complex ethical challenge, not just a technical one. DeepMind initially underestimated large language models (LLMs) but re-evaluated after ChatGPT's November 2022 launch garnered 100 million users in two months, intensifying the AI "arms race." The company now views artificial general intelligence (AGI) as potentially 3-5 years away, shifting focus to its transformative societal impacts on economics, politics, and human relationships. Concerns persist regarding anthropomorphic AI, the autonomous actions of AI agents, and the ethical implications of Google's agreement to allow military use of its AI technology.

Key takeaway

For Directors of AI/ML navigating intense commercial pressures, recognize that technical alignment alone is insufficient; your teams must proactively integrate ethical value alignment and societal impact assessments into development. Prioritize designing AI for a pluralistic world, considering the four-way relationship between the AI, user, developers, and society. This approach mitigates risks like anthropomorphic misuse and ensures responsible deployment, especially as AGI becomes imminent.

Key insights

The fundamental challenge in AI development lies in defining appropriate values for systems in a pluralistic world, beyond mere technical alignment.

Principles

Method

Developers should design AI for a world of diverse values, not a single value set. The four-party alignment framework provides a structure for tuning AI behavior.

In practice

Topics

Best for: AI Ethicist, Policy Maker, Director of AI/ML

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by AI (artificial intelligence) | The Guardian.