Collaborating on a nationwide randomized study of AI in real-world virtual care
Summary
Google Research, in partnership with Included Health, is launching a nationwide randomized study to evaluate conversational AI in real-world virtual care workflows, pending Institutional Review Board (IRB) approval. Scheduled for February 3, 2026, this study aims to gather rigorous prospective evidence on AI performance in clinical settings at scale, moving beyond simulations and retrospective data. This research builds on foundational work with systems like AMIE for diagnostic and management reasoning, the Personal Health Agent (PHA) for personalized health insights from wearables, and a "wayfinding" AI for navigating health information. The initiative follows earlier studies, including a single-center feasibility study with Beth Israel Deaconess Medical Center, which showed strong indications of safety. This large-scale randomized controlled trial will compare AI-managed patient interactions against standard clinical practice to understand capabilities and limitations for real patients and concerns.
Key takeaway
For research scientists developing AI for healthcare, this study sets a new standard for evidence generation, moving from simulated environments to large-scale, real-world randomized controlled trials. You should prioritize rigorous, phased evaluation of AI systems, focusing on safety and utility in actual clinical workflows. This approach is essential for building trust and ensuring responsible deployment of AI-powered care, making high-quality medical expertise more accessible.
Key insights
A nationwide randomized study will rigorously evaluate conversational AI in real-world virtual healthcare settings.
Principles
- Rigorous evidence generation is crucial for medical AI.
- Phased research ensures safety and usefulness.
- AI can enhance access to medical expertise.
Method
The study employs a randomized controlled trial design with consented participants nationwide, comparing AI-managed patient interactions to standard clinical practice in virtual care workflows.
In practice
- AMIE: AI for diagnostic and management reasoning.
- PHA: AI for personalized health insights from wearables.
- Wayfinding AI: AI for navigating health information.
Topics
- Conversational AI
- Virtual Care
- Healthcare AI
- Randomized Controlled Trials
- Medical Diagnostic Reasoning
Best for: Research Scientist, AI Researcher, AI Scientist, Data Scientist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by The latest research from Google.