DIMAS-OMOP: A Deliberative Intelligence-Based Multi-Agent System for Chinese Medical Text Standardization toward OMOP

· Source: Paper Index on ACL Anthology · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics, Robotics & Autonomous Systems · Depth: Expert, quick

Summary

DIMAS-OMOP is a Deliberative Intelligence-based Multi-Agent System designed to standardize Chinese clinical imaging reports for the Observational Medical Outcomes Partnership (OMOP) framework. Addressing challenges like linguistic complexity and inconsistent outputs, the system employs a hybrid three-stage workflow combining traditional natural language processing, selective Large Language Model reasoning, and Retrieval-Augmented Generation. Its core innovation is a hierarchical six-agent proposer-skeptic deliberation mechanism, supported by dynamic concept resolution and a four-dimensional quality control framework. Tested on 1,250 imaging reports, DIMAS-OMOP achieved 95.2% mapping accuracy, surpassing rule-based methods by 21.8 percentage points and single-AI baselines by 8.1 percentage points. The system processes 1,200 reports/hour, with the multi-agent deliberation stage alone boosting accuracy by 8.9%. Pilot deployment demonstrated a 160.6% return on investment and a 31.5% increase in workflow efficiency, offering a robust method for integrating non-English clinical data into the OHDSI ecosystem.

Key takeaway

For NLP Engineers or Research Scientists tasked with standardizing complex non-English clinical text for OMOP integration, DIMAS-OMOP demonstrates a highly effective methodology. You should consider implementing multi-agent deliberative systems combined with hybrid NLP and LLM architectures to achieve high accuracy and efficiency. This approach can significantly improve data fidelity and workflow efficiency, as shown by its 95.2% mapping accuracy and 160.6% ROI in pilot deployment.

Key insights

Multi-agent deliberation and hybrid NLP/LLM approaches significantly improve medical text standardization accuracy and efficiency.

Principles

Method

DIMAS-OMOP employs a three-stage workflow integrating traditional NLP, selective LLM reasoning, RAG, and a hierarchical six-agent proposer-skeptic deliberation mechanism for concept mapping.

In practice

Topics

Best for: AI Scientist, NLP Engineer, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.