A new plan emerges for AI apocalypse avoidance

2026-07-10 · Source: Semafor · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Emerging Technologies & Innovation · Depth: Fundamental Awareness, quick

Summary

The AI Futures Project, led by former OpenAI researcher Daniel Kokotajlo, has released "AI 2040: Plan A," advocating for a temporary, cooperative pause in frontier AI research by the US and China. This plan aims to establish safety frameworks, contrasting with the group's previous "gloomy prediction" of humanity's demise from unchecked AI. "Plan A" is not anti-AI, acknowledging that current AI capabilities, with sufficient data center capacity, can still drive years of innovation and unprecedented economic growth. While the plan is criticized for its optimistic assumption of global leadership cooperation, it suggests that AI safety and rapid economic growth are not mutually exclusive. The author questions whether an optimistic message about AI's promise might be more effective than fear-based motivation for promoting AI safety, noting China's push for a global AI cooperation organization and OpenAI's disagreements with the White House on safety rules.

Key takeaway

For policy makers weighing global AI governance strategies, "AI 2040: Plan A" suggests that advocating for a cooperative pause in frontier AI development between nations like the US and China could establish crucial safety frameworks. You should consider framing AI safety initiatives with an optimistic message about economic prosperity, rather than solely focusing on existential risks, to foster broader international buy-in and accelerate beneficial AI deployment.

Key insights

AI 2040: Plan A proposes a US-China pause on frontier AI research to build safety, asserting safety and growth can coexist.

Principles

• AI safety can align with economic growth.
• Current AI capabilities offer years of innovation.
• Fear-based messaging may hinder AI safety adoption.

Method

The article describes "Plan A" as advocating for a temporary, cooperative pause in frontier AI research between the US and China to establish safety scaffolding.

In practice

• Consider optimistic framing for AI safety.
• Prioritize data center capacity for AI benefits.

Topics

• AI Safety
• Frontier AI Research
• US-China Cooperation
• AI Governance
• Economic Growth
• AI Policy

Best for: Policy Maker, AI Ethicist, Tech Journalist

Related on AIssential

• Success without Dignity? Nathan finds Hope Amidst Chaos, from The Intelligence Horizon Podcast — AI timelines are rapidly compressing, bringing transformative capabilities and existential risks closer, necessitating robust defense-in-depth strategies.
• Introduction for and Reactions to Plan A — "Plan A" proposes a coordinated global strategy, including US-China cooperation and compute control, to manage superintelligence development by 2040.
• A Recommendation For The First Meeting Of Ai Safety Institutes — The International Network of AI Safety Institutes must re-center global discussions on AI safety to address escalating risks effectively.
• Summary: AI Governance to Avoid Extinction — Only a global "off switch" and halt to frontier AI development can prevent catastrophic risks.
• Ai Safety And The Us China Arms Race — AI safety measures are compatible with US national competitiveness and do not hinder its lead in innovation.
• AI Optimism vs AI Pessimism — The AI discourse is maturing, shifting from speculative doomsday scenarios to practical, fact-based discussions on economic and governance challenges.

See Counsel's argued verdicts on the open AI decisions leaders are weighing →

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Semafor.