Lessons from a Physician-CIO on AI Governance with Dr. Stacey Johnston

2026-04-23 · Source: AI Explained · Field: Health & Wellbeing — Healthcare Systems & Policy, Medical Devices & Health Technology, Clinical Care & Medical Practice · Depth: Intermediate, extended

Summary

Dr. Stacey Johnston, Chief Information and Digital Execution Officer at Beacon Health System, discusses the strategic implementation and governance of AI in healthcare. Beacon Health established an AI governance council and policies requiring a defined ROI for new tools, fostering disciplined adoption. The system is leveraging agentic AI for backend processes like autonomous coding, benefits verification, and scheduling, including a successful deployment that backloaded 100,000 appointments in two weeks. Clinically, AI is used for colon cancer screening, leading to early detection, and ambient listening solutions have increased per-physician revenue by $10,000 annually by improving documentation. Dr. Johnston emphasizes that successful AI adoption hinges on understanding workflows, robust change management, and incremental trust-building with clinicians, moving towards a federated but centrally monitored AI model.

Key takeaway

For CTOs and VPs of Engineering/Data in healthcare, establishing a robust AI governance council with clear ROI requirements is paramount before deploying new AI tools. Your organization should prioritize solutions that integrate seamlessly into existing clinical workflows and demonstrate tangible benefits, such as reduced documentation time or enhanced revenue capture, to incrementally build clinician trust and drive successful, scalable AI adoption across the health system.

Key insights

Effective healthcare AI adoption requires strong governance, workflow integration, and demonstrable ROI to build clinician trust.

Principles

• AI adoption is a workflow and change management issue, not purely technical.
• Defined ROI is a critical forcing function for disciplined AI adoption.
• Clinician trust in AI is earned incrementally through seamless workflow fit.

Method

Beacon Health established an AI Council, developed permitted/prohibited use policies, implemented vendor risk assessments for AI, and launched an AI literacy program to monitor for drift and bias.

In practice

• Prioritize AI solutions with clear ROI, especially in backend operations.
• Implement ambient listening solutions to reduce documentation time and increase revenue.
• Automate repetitive tasks like benefits verification and appointment scheduling with agentic AI.

Topics

• AI Governance
• Healthcare AI Adoption
• Agentic AI Solutions
• Ambient Listening AI
• Healthcare ROI

Best for: CTO, VP of Engineering/Data, Executive, Director of AI/ML, Consultant, MLOps Engineer

Related on AIssential

• AI Use Cases, Deployment, and Measuring Real-World ROI - with Ylan Kazi of Blue Cross Blue Shield of North Dakota — Successful AI adoption in regulated sectors requires clear organizational posture, robust governance, and a focus on measurable customer value.
• AI will become normal in publishing, but trust will become scarce. The market will reward those who can prove provenance, quality, legality and human accountability. — AI adoption in publishing outpaces trust and governance, creating an "adoption paradox" with significant ethical and operational challenges.
• Hidden AI, Real Risk: A Governance Roadmap For Mid-Market Organizations — Unsanctioned AI tool use by employees creates data risks and necessitates structured organizational management.
• Welcome to the “find out” stage of AI — AI is transitioning from experimental novelty to a phase demanding trust, reliability, and clear business value.
• The AI Ethics Brief #192: Canada Has a National AI Strategy. The Hard Questions Come Next. — Canada's AI strategy defers critical governance and accountability questions, creating a gap between stated intent and structural follow-through.
• When Companies Listen to Employees About AI, Everyone Benefits — Centering worker voice in AI development and implementation is essential for AI to benefit both employees and employers.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by AI Explained.