In the face of rampant AI, is ‘data poisoning’ a new form of civil disobedience?
Summary
Generative AI tools are eliciting both optimism and concern in advanced economies, with debates surrounding their environmental impact, productivity gains versus job displacement, and the perceived non-optionality of their use for white-collar workers. Amidst this rapid adoption, AI resistance efforts are emerging, ranging from social sanctions and boycotts to strikes, protests, and lawsuits, driven by perceived threats to jobs, ethics, safety, democracy, sovereignty, and the environment. Data poisoning, a modern form of civil disobedience, involves deliberately inserting misleading content into AI training data to degrade model outputs. While some methods require technical skills, tools like Glaze, Nightshade, CoProtector, and Silverer enable artists and social media users to protect their data. Simple actions like creating factitious websites or editing Wikipedia can also poison data, raising questions about its legality and ethical justification, particularly when viewed as a defense against potential societal harms.
Key takeaway
For CTOs and VPs of Engineering evaluating AI adoption and data governance, understanding data poisoning is crucial. Your teams must implement robust data validation and integrity checks to mitigate the risks of compromised training data, whether from malicious actors or ethically motivated resistance. Consider the potential for widespread, non-technical data poisoning and invest in detection mechanisms to ensure model reliability and prevent unintended amplification of inaccuracies.
Key insights
Data poisoning is an accessible form of AI resistance, raising complex ethical and legal questions regarding its use against perceived AI harms.
Principles
- AI resistance mirrors historical civil disobedience.
- Small data poisoning can compromise large models.
- Ethical civil disobedience may justify illegal acts.
Method
Data poisoning involves inserting misleading content into AI training data. This can be done via specialized tools like Glaze or Nightshade, or through simpler actions like creating factitious websites or editing public data sources.
In practice
- Artists can use Glaze/Nightshade to protect visual data.
- Social media users can use Silverer to doctor images.
- Creating factitious websites can poison training data.
Topics
- Generative AI
- Data Poisoning
- AI Resistance
- Civil Disobedience
- AI Ethics
Best for: CTO, VP of Engineering/Data, Director of AI/ML, AI Ethicist, Policy Maker, Legal Professional
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial intelligence (AI) – The Conversation.