提出伪立体输入解决自监督立体匹配中的遮挡难题
Pseudo-Stereo Inputs: A Solution to the Occlusion Challenge in Self-Supervised Stereo Matching
- 用伪立体输入分离输入与反馈,实现双向有效信号获取
- 在KITTI和Cityscapes上提升1.5%~2.3%的匹配精度
- 适合研究自监督视觉任务或遮挡问题的学者
自监督立体匹配虽无需昂贵真值数据,但主流基于光度一致性的方法仍受遮挡挑战困扰——无论网络结构如何,仅能从遮挡物一侧获得有效反馈信号。现有方法尝试通过识别并剔除错误信号,或引入额外正则化进行修正,却未能根本解决。本文提出更基础的解决方案:将单侧有效、单侧错误的固定状态,转变为可概率性地从遮挡物两侧均获取有效反馈。核心是构建一种伪立体输入策略,解耦输入与反馈过程,无需额外约束。定性结果显示,遮挡问题被彻底解决,遮挡物两侧性能完全对称且一致;定量实验验证,该方法显著提升性能,在KITTI和Cityscapes数据集上分别提升1.5%~2.3%。
原文摘要 · Abstract (English)
Self-supervised stereo matching holds great promise by eliminating the reliance on expensive ground-truth data. Its dominant paradigm, based on photometric consistency, is however fundamentally hindered by the occlusion challenge -- an issue that persists regardless of network architecture. The essential insight is that for any occluders, valid feedback signals can only be derived from the unoccluded areas on one side of the occluder. Existing methods attempt to address this by focusing on the erroneous feedback from the other side, either by identifying and removing it, or by introducing additional regularities for correction on that basis. Nevertheless, these approaches have failed to provide a complete solution. This work proposes a more fundamental solution. The core idea is to transform the fixed state of one-sided valid and one-sided erroneous signals into a probabilistic acquisition of valid feedback from both sides of an occluder. This is achieved through a complete framework, centered on a pseudo-stereo inputs strategy that decouples the input and feedback, without introducing any additional constraints. Qualitative results visually demonstrate that the occlusion problem is resolved, manifested by fully symmetrical and identical performance on both flanks of occluding objects. Quantitative experiments thoroughly validate the significant performance improvements resulting from solving the occlusion challenge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。