Open Source

2026-02-12 · Source: AI Now Institute · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cybersecurity & Data Privacy, Emerging Technologies & Innovation · Depth: Intermediate, medium

Summary

Meredith Whittaker, President of Signal, critiques the contemporary understanding of "open-source AI," arguing it deviates significantly from the precise technical protocols of open-source software. She contends that while open-source software fostered decentralization, "open-source AI" is often a "vibes-based" concept that provides rhetorical reassurance without addressing the fundamental concentration of data, labor, and infrastructure in AI development, primarily dominated by US and Chinese platform companies. Whittaker highlights that while reusing models or examining datasets can be useful, these benefits do not challenge the existing power structures or economies of scale. She advocates for a return to a pragmatic, technically grounded understanding of open source, emphasizing its role in establishing trust and scrutability, particularly for critical infrastructure like private communication.

Key takeaway

For AI Ethicists and Policy Makers evaluating "open-source AI" initiatives, you should critically assess whether these efforts genuinely address the underlying concentration of power and infrastructure, rather than merely offering rhetorical reassurance. Focus on concrete technical specifications and verifiable decentralization, ensuring that claims of openness translate into actual scrutability and democratic governance, especially for socially significant AI deployments.

Key insights

Open-source AI often misrepresents its capabilities, failing to address core power concentrations in the AI industry.

Principles

• Openness should be the floor for trustworthy technology.
• Technical precision is crucial for evaluating AI claims.
• Scrutability is essential for democratic governance of technology.

Method

Evaluate "open-source AI" claims by disentangling rhetorical halos from material realities, focusing on actual affordances versus promised benefits, and assessing impact on power concentration.

In practice

• Deploy small, mission-aligned open-source AI models on-device.
• Prioritize privacy-preserving uses for AI, like on-device face detection.
• Scrutinize code regularly to ensure integrity and identify vulnerabilities.

Topics

• Open-Source AI
• AI Governance
• Technological Concentration
• Data Privacy
• Scrutability

Best for: AI Ethicist, Policy Maker, Research Scientist

Related on AIssential

• Gaslighting Openness — Large companies manipulate narratives to restrict AI access, undermining Open Source and user agency.
• Should AI Be Open Source? — AI's "open source" often means open weights, not full transparency, complicating traditional open-source principles.
• The Pope’s new AI manifesto is a massive pitch for Open Source and Local Models — The Pope's encyclical "Magnifica Humanitas" advocates for open-source, decentralized AI to counter monopolistic control and ensure technology serves diverse human cultures.
• OpenAI was born from a genuine fear of concentrated AI power, but almost immediately became a contest over exactly the same thing — concentrated AI power. — OpenAI's founding was a complex interplay of public-benefit ideals and a struggle for control over powerful AI.
• Cresti’s core claim is simple: if you can’t explain where data goes and who can access it, you cannot credibly claim governance. — AI's integration into devices necessitates robust traceability and control to maintain digital sovereignty and institutional competence.
• AI for Good — The "AI for good" narrative often masks technosolutionism, weak evidence, and harmful practices by large tech corporations.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by AI Now Institute.