用神经网络预测距离图,实现更精确的实例分割。
Predicting Signed Distance Functions for Visual Instance Segmentation

- 训练网络在每个像素预测到物体轮廓的距离,沿多个方向生成距离图。
- 在COCO数据集上,前景交并比高于YOLACT,对复杂形状适应更好。
- 适合处理细长、不规则形状物体,为实例分割提供新思路。
视觉实例分割面临挑战,尤其当目标形状变化无常时。传统基于锚框的方法受限于预设矩形框,难以适配如绳索般细长的物体。本文提出新方法:训练神经网络在每个像素预测特定方向到最近物体轮廓的距离,通过聚合多方向距离图近似有符号距离函数(SDF),再通过阈值化得到前景-背景分割。与当前最优方法YOLACT相比,在COCO数据集上,该方法在前景交并比(IoU)上表现更优。尽管目前尚难直接映射至完整实例分割,但该思路能更好捕捉真实世界中多样化的物体形状,具有重要研究价值。
原文摘要 · Abstract (English)
Visual instance segmentation is a challenging problem and becomes even more difficult if objects of interest varies unconstrained in shape. Some objects are well described by a rectangle, however, this is hardly always the case. Consider for instance long, slender objects such as ropes. Anchor-based approaches classify predefined bounding boxes as either negative or positive and thus provide a limited set of shapes that can be handled. Defining anchor-boxes that fit well to all possible shapes leads to an infeasible number of prior boxes. We explore a different approach and propose to train a neural network to compute distance maps along different directions. The network is trained at each pixel to predict the distance to the closest object contour in a given direction. By pooling the distance maps we obtain an approximation to the signed distance function (SDF). The SDF may then be thresholded in order to obtain a foreground-background segmentation. We compare this segmentation to foreground segmentations obtained from the state-of-the-art instance segmentation method YOLACT. On the COCO dataset, our segmentation yields a higher performance in terms of foreground intersection over union (IoU). However, while the distance maps contain information on the individual instances, it is not straightforward to map them to the full instance segmentation. We still believe that this idea is a promising research direction for instance segmentation, as it better captures the different shapes found in the real world.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。