提出可形卷积,让模型显式学习复杂解剖结构的拓扑连通性。
Conformable Convolution for Topologically Aware Learning of Complex Anatomical Structures
- 用自适应卷积偏移聚焦拓扑重要区域,提升结构连通性建模能力。
- 在三个数据集上验证,分割结果拓扑保持性显著优于基线方法。
- 适用于需保持结构连续性的医学图像分析任务,如器官/血管分割。
传统计算机视觉侧重像素级与特征目标,但复杂生物结构的医学图像分析需显式表达其拓扑特性。尽管深度学习取得成功,模型仍难以准确捕捉细小、像素级薄却关键结构的连通性与连续性,因其依赖数据隐式学习。为解决此问题,本文提出可形卷积(Conformable Convolution),一种新型卷积层,能显式强制拓扑一致性。该卷积层学习自适应核偏移,优先关注图像中拓扑重要区域。这一优先机制由提出的拓扑后验生成器(TPG)模块引导,通过将特征图转换为立方复形并应用持久同调(persistent homology)识别关键拓扑特征。所提模块与架构无关,可无缝集成至多种网络。在分割任务中验证框架有效性,保持结构连通性至关重要。三组不同数据集实验表明,本框架在定量与定性层面均有效保留了分割结果的拓扑结构。
原文摘要 · Abstract (English)
While conventional computer vision emphasizes pixel-level and feature-based objectives, medical image analysis of intricate biological structures necessitates explicit representation of their complex topological properties. Despite their successes, deep learning models often struggle to accurately capture the connectivity and continuity of fine, sometimes pixel-thin, yet critical structures due to their reliance on implicit learning from data. Such shortcomings can significantly impact the reliability of analysis results and hinder clinical decision-making. To address this challenge, we introduce Conformable Convolution, a novel convolutional layer designed to explicitly enforce topological consistency. Conformable Convolution learns adaptive kernel offsets that preferentially focus on regions of high topological significance within an image. This prioritization is guided by our proposed Topological Posterior Generator (TPG) module, which leverages persistent homology. The TPG module identifies key topological features and guides the convolutional layers by applying persistent homology to feature maps transformed into cubical complexes. Our proposed modules are architecture-agnostic, enabling them to be integrated seamlessly into various architectures. We showcase the effectiveness of our framework in the segmentation task, where preserving the interconnectedness of structures is critical. Experimental results on three diverse datasets demonstrate that our framework effectively preserves the topology in the segmentation downstream task, both quantitatively and qualitatively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。