用AI生成乳腺3D模型,帮医生规划手术、让患者更好理解病情。
Artificial Intelligence in Breast Cancer Care: Transforming Preoperative Planning and Patient Education with 3D Reconstruction
- 引入人机协作的U-Mamba模型,提升多场景下器官分割泛化能力。
- 对乳腺整体、腺体组织分割准确率达97%,肿瘤分割达82%。
- 3D可视化显著改善医患沟通,助力共同决策与精准医疗。
本研究提出一种新型机器学习方法,用于提升3D解剖结构重建算法在不同数据集上的泛化能力,超越乳腺癌应用范畴。基于2018年1月至2023年6月间120例回顾性乳腺MRI数据,依次完成去标识化、手动分割T1加权及动态对比增强序列、配准与全乳腺、纤维腺体组织及肿瘤的分割,并使用ITK-SNAP实现3D可视化。通过人机协同流程优化分割结果,采用U-Mamba模型以增强跨成像场景的泛化性。使用骰子相似系数(Dice Similarity Coefficient, DSC)评估自动分割与人工标注的一致性:在T1加权图像上,整体器官分割DSC为0.97(±0.013),纤维腺体组织为0.96(±0.024),肿瘤为0.82(±0.12)。生成的3D重建图可清晰呈现复杂解剖结构。临床评估显示,医生认为其有助于术前规划、术中导航和决策支持;患者访谈表明,3D可视化提升了教育效果、沟通效率与理解程度。该人机协作的机器学习框架成功实现跨患者数据集的3D重建与分割泛化,为临床提供更优可视化工具,改善术前规划并强化患者教育,推动共享决策与知情选择,具有广泛医疗应用潜力。
原文摘要 · Abstract (English)
Effective preoperative planning requires accurate algorithms for segmenting anatomical structures across diverse datasets, but traditional models struggle with generalization. This study presents a novel machine learning methodology to improve algorithm generalization for 3D anatomical reconstruction beyond breast cancer applications. We processed 120 retrospective breast MRIs (January 2018-June 2023) through three phases: anonymization and manual segmentation of T1-weighted and dynamic contrast-enhanced sequences; co-registration and segmentation of whole breast, fibroglandular tissue, and tumors; and 3D visualization using ITK-SNAP. A human-in-the-loop approach refined segmentations using U-Mamba, designed to generalize across imaging scenarios. Dice similarity coefficient assessed overlap between automated segmentation and ground truth. Clinical relevance was evaluated through clinician and patient interviews. U-Mamba showed strong performance with DSC values of 0.97 ($\pm$0.013) for whole organs, 0.96 ($\pm$0.024) for fibroglandular tissue, and 0.82 ($\pm$0.12) for tumors on T1-weighted images. The model generated accurate 3D reconstructions enabling visualization of complex anatomical features. Clinician interviews indicated improved planning, intraoperative navigation, and decision support. Integration of 3D visualization enhanced patient education, communication, and understanding. This human-in-the-loop machine learning approach successfully generalizes algorithms for 3D reconstruction and anatomical segmentation across patient datasets, offering enhanced visualization for clinicians, improved preoperative planning, and more effective patient education, facilitating shared decision-making and empowering informed patient choices across medical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。