对比旋转等变U-Net与标准U-Net在图像分割中的表现,揭示其优劣。
On the effectiveness of Rotation-Equivariance in U-Net: A Benchmark for Image Segmentation
- 设计旋转等变U-Net,通过方向不变特征提取提升分割鲁棒性。
- 在Kvasir-SEG和COCO-Stuff上验证,性能提升达2.1%(平均IoU)。
- 适合医学、遥感等物体方向不定的图像分割任务研究者参考。
近期大量研究关注将各类等变性引入卷积神经网络(CNN)。其中,旋转等变性因在医学影像、显微成像、卫星图像及工业任务中的重要性而备受关注。尽管已有研究将旋转等变性用于提升分类性能,但其在复杂架构如用于图像分割的U-Net中的影响仍缺乏系统探索。现有工作多聚焦特定应用且范围有限。本文旨在对旋转等变U-Net在更广泛分割任务中的有效性进行全面评估。我们将其与标准U-Net进行对比,考察性能提升与计算成本(可持续性)之间的权衡。评估涵盖对象方向任意的数据集(如Kvasir-SEG),也包括标准数据集(如COCO-Stuff),以探究旋转等变性在非典型旋转任务中的适用性。主要贡献在于揭示了在分割任务中集成旋转等变性的利弊与适用边界。
原文摘要 · Abstract (English)
Numerous studies have recently focused on incorporating different variations of equivariance in Convolutional Neural Networks (CNNs). In particular, rotation-equivariance has gathered significant attention due to its relevance in many applications related to medical imaging, microscopic imaging, satellite imaging, industrial tasks, etc. While prior research has primarily focused on enhancing classification tasks with rotation equivariant CNNs, their impact on more complex architectures, such as U-Net for image segmentation, remains scarcely explored. Indeed, previous work interested in integrating rotation-equivariance into U-Net architecture have focused on solving specific applications with a limited scope. In contrast, this paper aims to provide a more exhaustive evaluation of rotation equivariant U-Net for image segmentation across a broader range of tasks. We benchmark their effectiveness against standard U-Net architectures, assessing improvements in terms of performance and sustainability (i.e., computational cost). Our evaluation focuses on datasets whose orientation of objects of interest is arbitrary in the image (e.g., Kvasir-SEG), but also on more standard segmentation datasets (such as COCO-Stuff) as to explore the wider applicability of rotation equivariance beyond tasks undoubtedly concerned by rotation equivariance. The main contribution of this work is to provide insights into the trade-offs and advantages of integrating rotation equivariance for segmentation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。