通过多任务互学习提升显著物体检测的完整性和边界精度。
A Mutual Learning Method for Salient Object Detection with intertwined Multi-Supervision--Revised
- 用显著物检测与前景轮廓、边缘检测互监督,生成更均匀的显著图。
- 在七个数据集上显著优于现有方法,显著图边界更精确。
- 适合关注图像分割和边缘感知的视觉任务研究者。
尽管深度学习在显著物体检测方面取得进展,但预测结果仍因物体内部结构复杂及卷积和池化操作带来的步幅问题,存在预测不完整和边界不准的问题。为此,本文提出一种基于多任务互学习的方法,利用显著物体检测、前景轮廓检测和边缘检测的联合监督。首先,将显著物体检测与前景轮廓检测交织训练,生成更均匀的显著图;其次,前景轮廓与边缘检测任务相互引导,提升轮廓预测精度并减少边缘预测中的局部噪声。此外,设计了一种新型互学习模块(MLM),由多个互训分支构成,显著提升模型性能。在七个具有挑战性的数据集上的大量实验表明,该方法在显著物体检测和边缘检测任务上均达到当前最优水平。
原文摘要 · Abstract (English)
Though deep learning techniques have made great progress in salient object detection recently, the predicted saliency maps still suffer from incomplete predictions due to the internal complexity of objects and inaccurate boundaries caused by strides in convolution and pooling operations. To alleviate these issues, we propose to train saliency detection networks by exploiting the supervision from not only salient object detection, but also foreground contour detection and edge detection. First, we leverage salient object detection and foreground contour detection tasks in an intertwined manner to generate saliency maps with uniform highlight. Second, the foreground contour and edge detection tasks guide each other simultaneously, thereby leading to precise foreground contour prediction and reducing the local noises for edge prediction. In addition, we develop a novel mutual learning module (MLM) which serves as the building block of our method. Each MLM consists of multiple network branches trained in a mutual learning manner, which improves the performance by a large margin. Extensive experiments on seven challenging datasets demonstrate that the proposed method has delivered state-of-the-art results in both salient object detection and edge detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。