利用医生注视轨迹提升心脏超声图像分割的域适应能力。
Gaze-Assisted Human-Centric Domain Adaptation for Cardiac Ultrasound Image Segmentation
- 引入医生注视轨迹作为人类认知引导,增强模型跨域识别能力。
- 在目标域上分割精度显著优于基于GAN和自训练的方法。
- 适合临床医学图像分割场景,尤其对标注稀缺数据有效。
心脏超声图像分割的域适应具有重要临床价值。然而,现有方法易受伪标签不完整和目标域到源域图像质量差的影响。以人为中心的域适应可借助人类认知引导模型适应目标域,减少对标注的依赖。医生注视轨迹蕴含丰富的跨域认知信息。为此,提出注视辅助的人类中心域适应(GAHCDA),通过两个模块实现:(1) 注视增强对齐(GAA):使模型获取人类认知的通用特征,以在不同域的心脏超声图像中识别分割目标;(2) 注视平衡损失(GBL):将注视热图与输出融合,使分割结果在结构上更贴近目标域。实验表明,所提框架在目标域上的分割效果优于基于GAN和自训练的方法,展现出良好的临床应用潜力。
原文摘要 · Abstract (English)
Domain adaptation (DA) for cardiac ultrasound image segmentation is clinically significant and valuable. However, previous domain adaptation methods are prone to be affected by the incomplete pseudo-label and low-quality target to source images. Human-centric domain adaptation has great advantages of human cognitive guidance to help model adapt to target domain and reduce reliance on labels. Doctor gaze trajectories contains a large amount of cross-domain human guidance. To leverage gaze information and human cognition for guiding domain adaptation, we propose gaze-assisted human-centric domain adaptation (GAHCDA), which reliably guides the domain adaptation of cardiac ultrasound images. GAHCDA includes following modules: (1) Gaze Augment Alignment (GAA): GAA enables the model to obtain human cognition general features to recognize segmentation target in different domain of cardiac ultrasound images like humans. (2) Gaze Balance Loss (GBL): GBL fused gaze heatmap with outputs which makes the segmentation result structurally closer to the target domain. The experimental results illustrate that our proposed framework is able to segment cardiac ultrasound images more effectively in the target domain than GAN-based methods and other self-train based methods, showing great potential in clinical application.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。