arXiv:2507.01401cs.CVcs.AI2025-07中稿 · MICCAI 2025被引 3

无需标准切面定位,用医学知识引导的多实例学习法提升胎儿腹腔异常诊断准确率。

Medical-Knowledge Driven Multiple Instance Learning for Classifying Severe Abdominal Anomalies on Prenatal Ultrasound

  • 采用注意力专家混合模块动态加权不同切面的特征权重。
  • 在2419例、24748张图像上实现6类异常分类,性能超越现有方法。
  • 适合产前超声智能诊断研究者和医学影像AI开发者参考。

胎儿腹腔畸形是严重先天性异常,需精准诊断以指导妊娠管理并降低死亡率。尽管人工智能在医疗诊断中展现出巨大潜力,但其在产前腹腔异常中的应用仍受限。现有研究多聚焦图像级分类,依赖标准切面定位,较少关注病例级诊断。本文提出一种无需标准切面定位的病例级多实例学习(MIL)方法,用于产前超声中胎儿腹腔异常分类。贡献有三:首先,采用注意力专家混合模块(MoAE)动态加权不同切面的注意力头;其次,提出医学知识驱动的特征选择模块(MFS),将图像特征与医学知识对齐,并在病例级实现自监督图像标记选择;最后,引入基于提示的原型学习(PPL)增强MFS。在包含2419例、共24748张图像、6个类别的大规模产前腹腔超声数据集上广泛验证,所提方法优于现有最先进模型。代码已公开于:https://github.com/LL-AC/AAcls。

原文摘要 · Abstract (English)

Fetal abdominal malformations are serious congenital anomalies that require accurate diagnosis to guide pregnancy management and reduce mortality. Although AI has demonstrated significant potential in medical diagnosis, its application to prenatal abdominal anomalies remains limited. Most existing studies focus on image-level classification and rely on standard plane localization, placing less emphasis on case-level diagnosis. In this paper, we develop a case-level multiple instance learning (MIL)-based method, free of standard plane localization, for classifying fetal abdominal anomalies in prenatal ultrasound. Our contribution is three-fold. First, we adopt a mixture-of-attention-experts module (MoAE) to weight different attention heads for various planes. Secondly, we propose a medical-knowledge-driven feature selection module (MFS) to align image features with medical knowledge, performing self-supervised image token selection at the case-level. Finally, we propose a prompt-based prototype learning (PPL) to enhance the MFS. Extensively validated on a large prenatal abdominal ultrasound dataset containing 2,419 cases, with a total of 24,748 images and 6 categories, our proposed method outperforms the state-of-the-art competitors. Codes are available at:https://github.com/LL-AC/AAcls.

医学影像多实例学习超声诊断人工智能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。