通过多尺度输入输出提升显著物体检测能力,更准识别不同大小目标。
MIMONet: Multi-scale Input and Multi-scale Output Network for Salient Object Detection

- 三尺度图像输入+跨分支信息交互,学习目标大小变化规律。
- 在DUTS-SEG、ECSSD等5个数据集上优于现有模型,最高提升6.2%。
- 适合需要高精度检测小目标或大范围物体的视觉任务使用。
现有显著性检测方法侧重多层级特征的应用,以利用高低层特征的优势。然而,由于输入为单一尺寸图像,其多层级特征难以学习显著目标的尺寸变化知识。目标尺度变化学习对检测多尺度物体具有巨大潜力,但尚未被充分探索。为此,受图像金字塔启发,我们提出多尺度输入与多尺度输出网络(MIMONet)。MIMONet对三个不同分辨率的图像提取多层级特征,形成三条编码分支,并在分支间交换信息。该设计使某一分支的特征能从其他两分支中学习目标尺寸变化的知识。此外,设计了多尺度感知(MSP)模块,将输入特征层划分为多个不同分辨率的子层,捕捉对象的多层次结构信息,实现更全面感知。训练方面,提出联合显著性损失(JSL),约束网络输出的多个显著图识别同一前景对象,同时保持边界清晰。实验表明,相较于现有模型,MIMONet在多个数据集上具备更强检测能力,取得更高评价分数。模型代码将公开。
原文摘要 · Abstract (English)
The existing methods for saliency detection task focus on the application of multi-level features, aiming to take advantage of the respective strengths of high- and low-level features. However, because the inputs of these models are single-size images, their multi-level features have difficulty in learning the knowledge of size variations of salient objects. Object-scale variation learning has great potential for detecting multi-scale objects, which has not been fully explored by existing methods. To improve the recognition ability of a model for objects with different sizes, we are inspired by the image pyramid to propose a Multi-scale Input and Multi-scale Output Network (MIMONet). In MIMONet, we extract multi-level features for three images with different resolutions to form three encoder branches, and information will be exchanged between the branches. The advantage of this approach is that the features of one branch can learn the knowledge of target size variation from the features of the other two branches. In addition, we design a Multi-scale Perception (MSP) module, in which the input feature layer is divided into several sub-layers with different resolutions. Capturing the multi-level structure information of the objects in these sub-layers can make the objects more fully perceived. For network training, we propose a Joint Saliency Loss (JSL), which can constrain multiple saliency maps output by the network to identify the same foreground objects, and induce their boundaries to be preserved clearly. Experimental results show that MIMONet has stronger detection capabilities and harvests better evaluation scores on multiple datasets compared to existing models. The code of our model will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。