Validating a Deep Learning Algorithm to Identify Patients with Glaucoma using Systemic Electronic Health Records
Summary
Researchers evaluated a deep learning-based glaucoma risk assessment (GRA) model, initially trained on national "All of Us" data, for its ability to identify high-probability glaucoma patients using only systemic electronic health records (EHR) at an independent institution. In a cross-sectional study, 20,636 Stanford patients seen from November 2013 to January 2024 were included, with 15% having glaucoma. The pretrained GRA model was fine-tuned on the Stanford cohort, using demographics, systemic diagnoses, medications, laboratory results, and physical examination measurements as inputs. The best model achieved an AUROC of 0.883 and a Positive Predictive Value (PPV) of 0.657. Calibration was strong, with the highest prediction decile showing a 65.7% glaucoma diagnosis rate and a 57.0% treatment rate. Performance improved with more trainable layers (up to 15) and additional data.
Key takeaway
For healthcare providers and AI scientists developing diagnostic tools, this study demonstrates that an EHR-only deep learning model can effectively identify patients at high risk for glaucoma. You should consider integrating such models for scalable and accessible pre-screening, potentially reducing the need for immediate specialized imaging and streamlining patient triage in ophthalmology.
Key insights
An EHR-only deep learning model can effectively pre-screen for glaucoma without specialized imaging.
Principles
- Model performance improves with more trainable layers.
- Additional data enhances model accuracy.
Method
A pretrained glaucoma risk assessment model was fine-tuned on an independent patient cohort using systemic EHR data, including demographics, diagnoses, medications, labs, and physical exam measurements.
In practice
- Utilize systemic EHR for glaucoma pre-screening.
- Fine-tune existing models on local patient data.
Topics
- Deep Learning
- Glaucoma Risk Assessment
- Electronic Health Records
- Clinical Validation
- Machine Learning
Best for: AI Scientist, Research Scientist, Data Scientist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by cs.LG updates on arXiv.org.