AI, Corporate Responsibility & Democratic Legitimacy: Extended Q&A • Joanna Bryson • GOTO 2025

2026-07-23 · Source: GOTO Conferences · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Public Policy & Governance, Emerging Technologies & Innovation · Depth: Intermediate, extended

Summary

The Q&A session with Joanna Bryson at GOTO 2025 addresses critical aspects of AI, corporate responsibility, and democratic legitimacy. Bryson challenges the notion of AGI as "real intelligence," describing current large language models (LLMs) as sophisticated systems for "uploading what we as a culture know," which plateau near human capacity. She discusses the phenomenon of "hallucinations" as a trade-off for creativity in LLMs like Google's Bard (now Gemini). Bryson expresses concern about the lack of scientific data on the negative impacts of chatbots providing life-altering advice, noting potential overdependence in certain personality types. She highlights the moral hazard of corporations unleashing AI agents without responsibility, citing Twitter's shift from user-curated content to recommender algorithms as an example of corporate control leading to weaponizable platforms. Bryson also emphasizes the need for human-comprehensible legislative text, even if AI-assisted, and challenges the perceived trade-off between AI interpretability and performance, advocating for developer understanding and robust testing for accountability.

Key takeaway

For AI ethicists and policymakers evaluating regulatory frameworks, recognize that current AI systems primarily reflect and amplify existing human knowledge, not independent intelligence. Your focus should be on establishing clear accountability for corporations deploying AI agents, particularly those offering "life-altering" advice, to mitigate moral hazards and prevent weaponization. Advocate for regulations that mandate transparency, ensure human comprehensibility of AI-assisted legal texts, and challenge false trade-offs between interpretability and performance. Encourage public engagement with local governments and political parties to influence AI governance.

Key insights

Current AI excels at uploading existing human knowledge, not generating novel intelligence beyond our collective frontier.

Principles

• AI "hallucinations" are a trade-off for creativity, reducing evidence thresholds.
• Corporate control over AI agents creates moral hazards and weaponizable platforms.
• Interpretability and performance in AI are not always a direct trade-off.

In practice

• Prioritize human-comprehensible legislative text, even if AI-assisted.
• Demand transparency and accountability from AI developers and corporations.
• Engage students or local startups to explore valuable, unused data.

Topics

• AI Governance
• Corporate Responsibility
• Democratic Legitimacy
• Large Language Models
• AI Ethics
• Algorithmic Transparency

Best for: AI Product Manager, AI Ethicist, Policy Maker, Director of AI/ML

Related on AIssential

• Corporate AI Governance Matters Now More Than Ever — Corporate AI governance is essential for responsible innovation, mitigating risks faster than regulation can.
• 19 Anti-Populist Takes on AI — AI's societal integration is complex, challenging simplistic narratives about human-machine conflict and its impact on labor, art, education, and regulation.
• The AI Ethics Brief #180: Emerging Tech with Established Issues — Emerging AI technologies necessitate transparency and explainability to address new ethical challenges and preserve human agency.
• AI Doesn’t Need to Be Right. It Only Needs to Sound Procedural — AI's procedural language masks uncertainty, enabling policy formation without visible accountability beyond mere hallucination.
• The 1970 Law That Solves AI’s Legitimacy Crisis — AI requires human-defined meaning and accountability, mirroring the governance principles of the 1970 Fair Credit Reporting Act.
• Artificial intelligence raises profound moral questions — for all of humanity to answer — AI's profound moral questions necessitate independent regulation and democratic public governance, not corporate self-regulation or "participation-washing."

See Counsel's argued verdicts on the open AI decisions leaders are weighing →

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by GOTO Conferences.