A domain-adapted large language model to support clinicians in psychiatric clinical practice
Summary
PsychFound is a 7B-parameter, domain-adapted large language model (LLM) designed to support psychiatric clinical practice, developed by Shanghai Jiao Tong University and Beijing Anding Hospital. It was trained using a three-phase framework incorporating expert-curated psychiatric corpora and 64,588 Chinese real-world electronic health records. PsychFound integrates professional psychiatric knowledge and clinical reasoning across diagnosis, treatment planning, and longitudinal management in Chinese clinical settings. Retrospective evaluations across three knowledge assessments and five clinical task benchmarks showed PsychFound outperformed 22 other LLMs. A prospective study demonstrated that resident psychiatrists assisted by PsychFound achieved higher consultation quality, improved diagnostic accuracy, more appropriate medication selection, and reduced documentation time (all P < 0.01). A reader study with 60 psychiatrists found PsychFound's clinical reasoning matched that of attending psychiatrists.
Key takeaway
For AI Product Managers developing clinical decision support tools, PsychFound demonstrates that deep domain adaptation and integration into existing workflows are critical for real-world utility. You should prioritize developing LLMs with expert-curated data and validate their performance through both retrospective benchmarks and prospective clinical studies to ensure they meet or exceed human expert capabilities in specific tasks like diagnosis and treatment planning.
Key insights
Domain-adapted LLMs can significantly enhance psychiatric clinical workflows, improving accuracy and efficiency.
Principles
- Clinical workflow alignment is crucial for LLM adoption.
- Expert-curated data improves domain adaptation.
- LLM assistance can match expert human reasoning.
Method
PsychFound was developed via a three-phase framework, utilizing expert-curated psychiatric corpora and 64,588 Chinese real-world EHRs for domain adaptation and clinical reasoning integration.
In practice
- Use PsychFound for psychiatric diagnosis support.
- Apply PsychFound for treatment planning assistance.
- Integrate PsychFound to reduce documentation burden.
Topics
- PsychFound
- Large Language Models
- Psychiatric Clinical Practice
- Electronic Health Records
- Clinical Decision Support
Code references
Best for: Executive, AI Product Manager, AI Scientist, Research Scientist, Domain Expert
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Nature Machine Intelligence.