利用场景信息提升遮挡物体识别准确率
Improving Classification of Occluded Objects through Scene Context
- 根据场景背景动态选择检测网络,提前优化识别策略
- 在检测后融合场景知识,使遮挡物体识别召回率和精确率均提升
- 方法可解释且适配多种数据集,适合实际部署
遮挡严重挑战了现有强大的目标识别算法。额外信息对缓解遮挡导致的错误极为关键。生物视觉中已知场景上下文有助于目标识别。本文通过两种基于场景信息融合的技术,增强现有的RPN-DCNN目标检测网络的鲁棒性。第一种方法在预测前进行,依据识别出的背景场景选择定制化的目标网络;第二种方法在检测后进行,将场景知识融入RPN输出的初始目标得分中。我们在包含部分遮挡的挑战性数据集上验证了该方法,结果表明其在召回率和精确率上均优于基线方法。此外,实验对比了多种遮挡处理训练策略,发现同时使用遮挡与非遮挡图像训练效果最佳。该方法具备可解释性,易于迁移至其他数据集,为未来研究与应用提供广阔空间。
原文摘要 · Abstract (English)
The presence of occlusions has provided substantial challenges to typically-powerful object recognition algorithms. Additional sources of information can be extremely valuable to reduce errors caused by occlusions. Scene context is known to aid in object recognition in biological vision. In this work, we attempt to add robustness into existing Region Proposal Network-Deep Convolutional Neural Network (RPN-DCNN) object detection networks through two distinct scene-based information fusion techniques. We present one algorithm under each methodology: the first operates prior to prediction, selecting a custom object network to use based on the identified background scene, and the second operates after detection, fusing scene knowledge into initial object scores output by the RPN. We demonstrate our algorithms on challenging datasets featuring partial occlusions, which show overall improvement in both recall and precision against baseline methods. In addition, our experiments contrast multiple training methodologies for occlusion handling, finding that training on a combination of both occluded and unoccluded images demonstrates an improvement over the others. Our method is interpretable and can easily be adapted to other datasets, offering many future directions for research and practical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。