arXiv:2510.15208cs.CV2025-10ICCV被引 2

首个融合超声与临床数据的先天性心脏病识别数据集,提升诊断准确性。

CARDIUM: Congenital Anomaly Recognition with Diagnostic Images and Unified Medical records

  • 构建多模态Transformer模型,通过跨注意力融合影像与表格数据特征。
  • 相比单模态方法,检测准确率提升11%(图像)和50%(表格),F1达79.8%。
  • 适合医学AI研究者、产前诊断团队及多模态模型开发者使用。

产前先天性心脏病(CHDs)的AI辅助诊断具有巨大潜力,但受限于罕见病导致的高质量数据稀缺,现有数据集存在严重不平衡和质量低的问题,且缺乏影像与临床数据的整合,制约了AI在临床决策中的应用。为此,我们提出首个公开可用的多模态数据集CARDIUM,整合胎儿超声与心脏超声影像及产妇临床记录,用于产前CHD检测。同时,设计一种基于交叉注意力机制的鲁棒多模态Transformer架构,融合图像与表格数据特征,在CARDIUM数据集上相较仅用图像或仅用表格的单模态方法分别提升11%和50%的检测性能,达到79.8±4.8%的F1分数。我们将公开数据集与代码,推动该领域研究发展。数据与代码已发布于https://github.com/BCV-Uniandes/Cardium及项目官网https://bcv-uniandes.github.io/CardiumPage/

原文摘要 · Abstract (English)

Prenatal diagnosis of Congenital Heart Diseases (CHDs) holds great potential for Artificial Intelligence (AI)-driven solutions. However, collecting high-quality diagnostic data remains difficult due to the rarity of these conditions, resulting in imbalanced and low-quality datasets that hinder model performance. Moreover, no public efforts have been made to integrate multiple sources of information, such as imaging and clinical data, further limiting the ability of AI models to support and enhance clinical decision-making. To overcome these challenges, we introduce the Congenital Anomaly Recognition with Diagnostic Images and Unified Medical records (CARDIUM) dataset, the first publicly available multimodal dataset consolidating fetal ultrasound and echocardiographic images along with maternal clinical records for prenatal CHD detection. Furthermore, we propose a robust multimodal transformer architecture that incorporates a cross-attention mechanism to fuse feature representations from image and tabular data, improving CHD detection by 11% and 50% over image and tabular single-modality approaches, respectively, and achieving an F1 score of 79.8 $\pm$ 4.8% in the CARDIUM dataset. We will publicly release our dataset and code to encourage further research on this unexplored field. Our dataset and code are available at https://github.com/BCV-Uniandes/Cardium, and at the project website https://bcv-uniandes.github.io/CardiumPage/

先天性心脏病多模态学习医学影像产前诊断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。