The AI Ethics Brief #190: The Data We Leave Behind

2026-01-20 · Source: The AI Ethics Brief · Field: Government & Public Sector — Public Policy & Governance, Regulatory & Compliance · Depth: Intermediate, medium

Summary

The AI Ethics Brief, a bi-weekly publication by the Montreal AI Ethics Institute, highlights critical issues surrounding data reuse, AI-generated misinformation, and the absence of effective governance. It details cases where personal data, such as therapy sessions from Talkspace and Slack archives from defunct companies, is repurposed for AI training or legal evidence without the original consent of the individuals involved. The brief also exposes instances of AI hallucination in official documents, including South Africa's draft national AI policy and legal filings by a major law firm, alongside a retracted Springer Nature meta-analysis that falsely claimed positive impacts of ChatGPT on learning. These examples underscore a recurring pattern: data collection often precedes governance, leaving individuals vulnerable to unforeseen consequences as their data changes hands and purpose.

Key takeaway

For CTOs and VPs of Engineering/Data evaluating AI adoption, recognize that data governance is paramount. Your organization's data, even "de-identified" or historical archives, can be repurposed in ways that violate trust or expose legal liabilities. Prioritize comprehensive data lifecycle management and ensure explicit consent mechanisms are in place for any data reuse, especially for AI training, to mitigate significant ethical and reputational risks.

Key insights

Data reuse without consent and AI-generated misinformation erode trust and highlight critical governance gaps.

Principles

• Data purpose changes, consent does not.
• Absence of regulation is a policy choice.
• Verification is crucial for AI-assisted outputs.

In practice

• Audit data retention and usage policies.
• Implement robust verification for AI-generated content.
• Engage stakeholders in tech future discussions.

Topics

• AI Ethics
• Data Reuse
• Data Privacy
• AI Hallucinations
• AI Governance

Best for: CTO, VP of Engineering/Data, Director of AI/ML, AI Ethicist, Policy Maker, Legal Professional

Related on AIssential

• The AI Ethics Brief #188: The Names We Give Things — The gap between AI's stated purpose and its actual implementation creates ethical and privacy challenges.
• Adaptive Data Governance for EU Regulatory Change — Adaptive data governance and AI automation are crucial for financial institutions navigating evolving EU digital regulations.
• The AI Interview: Alice Xiang, Sony — Responsible AI demands a deeper focus on ethically sourced training data, not just model outputs, to prevent inherent biases.
• AI, user data and the asymmetry of understanding — The core challenge in AI data privacy is the widening cognitive gap between organizational data use and user comprehension.
• Digital monitoring is growing in South Africa’s public service – regulation needs to catch up — Rapid digital tool adoption in public sector evaluation outpaces ethical governance, creating risks for citizens and data integrity.
• Hidden AI, Real Risk: A Governance Roadmap For Mid-Market Organizations — Unsanctioned AI tool use by employees creates data risks and necessitates structured organizational management.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by The AI Ethics Brief.