通过不确定性学习难度,提升光流与立体深度估计精度
Improving Optical Flow and Stereo Depth Estimation by Leveraging Uncertainty-Based Learning Difficulties
- 用误差置信度引导网络关注难样本像素
- 结合循环一致性,有效缓解遮挡区域的估计偏差
- 适合需要高精度视觉感知的自动驾驶场景
传统光流与立体深度模型通常对所有像素使用统一损失函数,但这种‘一刀切’方法忽略了像素和区域间学习难度的显著差异。本文研究基于不确定性的置信度图,捕捉空间上变化的学习难度,并提出针对性解决方案。首先提出难度平衡(DB)损失,利用误差置信度使网络更关注困难像素和区域;其次发现部分难点源于遮挡,由缺乏真实对应关系导致的病态匹配问题引发。为此提出遮挡规避(OA)损失,引导网络聚焦于基于循环一致性的可信区域,以提升特征匹配可靠性。将DB与OA损失结合后,在训练中有效应对多种挑战性像素与区域。在光流与立体深度任务上的实验表明,该组合可显著提升性能。
原文摘要 · Abstract (English)
Conventional training for optical flow and stereo depth models typically employs a uniform loss function across all pixels. However, this one-size-fits-all approach often overlooks the significant variations in learning difficulty among individual pixels and contextual regions. This paper investigates the uncertainty-based confidence maps which capture these spatially varying learning difficulties and introduces tailored solutions to address them. We first present the Difficulty Balancing (DB) loss, which utilizes an error-based confidence measure to encourage the network to focus more on challenging pixels and regions. Moreover, we identify that some difficult pixels and regions are affected by occlusions, resulting from the inherently ill-posed matching problem in the absence of real correspondences. To address this, we propose the Occlusion Avoiding (OA) loss, designed to guide the network into cycle consistency-based confident regions, where feature matching is more reliable. By combining the DB and OA losses, we effectively manage various types of challenging pixels and regions during training. Experiments on both optical flow and stereo depth tasks consistently demonstrate significant performance improvements when applying our proposed combination of the DB and OA losses.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。