arXiv:2409.02046cs.CV2024-09被引 17

通过人机协作提升子宫内膜异位症的影像诊断准确率

Human-AI Collaborative Multi-modal Multi-rater Learning for Endometriosis Diagnosis

  • 融合多评级医生与AI的协同学习框架
  • 在自建MRI数据集上超越专家团队表现
  • 适合医学影像智能辅助诊断研究者参考

子宫内膜异位症影响约10%的女性,诊断困难。常规依赖腹腔镜或T1/T2 MRI影像分析,后者虽快速廉价但准确性较低。关键诊断标志是Douglas隐窝(POD)消失,但即使经验丰富的医生也难以准确判断,导致训练可靠AI模型困难。本文提出人类-人工智能协同的多模态多评级学习方法(HAICOMM),首次整合三个关键点:1)多评级学习,从多个“噪声标签”中提取更清洁的标签;2)多模态学习,利用T1/T2 MRI影像进行训练和测试;3)人机协作,结合临床医生与AI预测,实现比单独医生或AI更高的分类精度。在我们自建的多评级T1/T2 MRI子宫内膜异位症数据集上验证,所提HAICOMM模型优于临床医生集成、噪声标签学习模型及多评级学习方法。

原文摘要 · Abstract (English)

Endometriosis, affecting about 10% of individuals assigned female at birth, is challenging to diagnose and manage. Diagnosis typically involves the identification of various signs of the disease using either laparoscopic surgery or the analysis of T1/T2 MRI images, with the latter being quicker and cheaper but less accurate. A key diagnostic sign of endometriosis is the obliteration of the Pouch of Douglas (POD). However, even experienced clinicians struggle with accurately classifying POD obliteration from MRI images, which complicates the training of reliable AI models. In this paper, we introduce the Human-AI Collaborative Multi-modal Multi-rater Learning (HAICOMM) methodology to address the challenge above. HAICOMM is the first method that explores three important aspects of this problem: 1) multi-rater learning to extract a cleaner label from the multiple "noisy" labels available per training sample; 2) multi-modal learning to leverage the presence of T1/T2 MRI images for training and testing; and 3) human-AI collaboration to build a system that leverages the predictions from clinicians and the AI model to provide more accurate classification than standalone clinicians and AI models. Presenting results on the multi-rater T1/T2 MRI endometriosis dataset that we collected to validate our methodology, the proposed HAICOMM model outperforms an ensemble of clinicians, noisy-label learning models, and multi-rater learning methods.

医学影像人机协作多模态诊断辅助

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。