智能多模态系统实现心脏MRI自动诊断,准确高效。
BAAI Cardiac Agent: An intelligent multimodal agent for automated reasoning and diagnosis of cardiovascular diseases from cardiac magnetic resonance imaging
- 整合多个专家模型,端到端完成心脏结构分割、功能量化和疾病诊断。
- 在7类心血管病上AUC达0.93(内)和0.81(外),心功能参数相关性超0.90。
- 生成报告与放射科医生高度一致,适合临床辅助诊断场景。
心脏磁共振(CMR)是心血管疾病诊断的核心手段,但因其多序列、多相位、定量指标复杂,依赖专业经验,导致应用受限。本文提出BAAI Cardiac Agent,一个用于端到端CMR解读的多模态智能系统。该系统集成专用心脏专家模型,实现心脏结构自动分割、功能量化、组织特征分析及疾病诊断,并在统一工作流中生成结构化临床报告。在两家医院的CMR数据集(2413例患者)上评估,涵盖7类主要心血管疾病,内部AUC超过0.93,外部AUC达0.81。在左心室功能指标估计任务中,射血分数、每搏输出量和左心室质量等核心参数与临床报告的皮尔逊相关系数均超过0.90。该系统在分割和诊断任务上优于现有最先进模型,生成报告与六名不同经验水平的放射科医生高度一致。通过动态协调专家模型进行协同多模态分析,该框架实现了精准高效的CMR解读,展现了在复杂临床影像流程中的潜力。代码已开源:https://github.com/plantain-herb/Cardiac-Agent。
原文摘要 · Abstract (English)
Cardiac magnetic resonance (CMR) is a cornerstone for diagnosing cardiovascular disease. However, it remains underutilized due to complex, time-consuming interpretation across multi-sequences, phases, quantitative measures that heavily reliant on specialized expertise. Here, we present BAAI Cardiac Agent, a multimodal intelligent system designed for end-to-end CMR interpretation. The agent integrates specialized cardiac expert models to perform automated segmentation of cardiac structures, functional quantification, tissue characterization and disease diagnosis, and generates structured clinical reports within a unified workflow. Evaluated on CMR datasets from two hospitals (2413 patients) spanning 7-types of major cardiovascular diseases, the agent achieved an area under the receiver-operating-characteristic curve exceeding 0.93 internally and 0.81 externally. In the task of estimating left ventricular function indices, the results generated by this system for core parameters such as ejection fraction, stroke volume, and left ventricular mass are highly consistent with clinical reports, with Pearson correlation coefficients all exceeding 0.90. The agent outperformed state-of-the-art models in segmentation and diagnostic tasks, and generated clinical reports showing high concordance with expert radiologists (six readers across three experience levels). By dynamically orchestrating expert models for coordinated multimodal analysis, this agent framework enables accurate, efficient CMR interpretation and highlights its potentials for complex clinical imaging workflows. Code is available at https://github.com/plantain-herb/Cardiac-Agent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。