构建426万标注的遮挡边界数据集,解决真实世界中遮挡边界的不一致标注问题。
RealOOB: A Definition-Consistent Real-World Oriented Occlusion Boundary Benchmark

- 基于真实世界图像构建定义一致的遮挡边界标注,覆盖物体间与自遮挡场景。
- 发现当前边缘检测器虽定位精准,但遮挡方向预测能力普遍较弱。
- 适合研究几何推理、深度估计和低层视觉任务的模型评估与验证。
遮挡边界(OBs)是对应于由遮挡引起的表面可见性不连续性的像素级图像边界。通过精确的边界定位和遮挡方向信息,OBs编码了局部表面布局与深度排序,为场景理解提供几何驱动的中层线索。然而,像素级OB估计进展受限于碎片化标注:现有基准常存在覆盖范围有限、类别特定设计、缺失自遮挡标注或标注定义不一致等问题。与此同时,现代边缘检测器和单目深度估计算法已成为强大的边界与几何预测器,但其与定义一致的OB之间的关系尚未充分探索。我们提出RealOOB,一个精心标注的真实世界基准,包含426万条定义一致、基于几何的遮挡边界标签,覆盖物体间与自遮挡边界,并引入有效性感知的遮挡方向图,仅对跨边界深度排序可可靠测量的像素提供监督。基于RealOOB,我们评估了40种遮挡边界估计算法及边缘检测器,以及6种单目深度估计算法。评估结果揭示了明显的遮挡推理差距:现代边缘检测器在定位上表现接近专用OB方法,而所有方法在方向预测上仍具挑战;即使强深度估计算法也常在真实遮挡边界处无法呈现可测量的几何特征。我们认为RealOOB为遮挡边界估计领域提供了可靠的参考基准,并为更广泛的低层视觉任务中的深度不连续性和几何保真度评估提供了真实世界测试平台。数据集与代码将公开发布。
原文摘要 · Abstract (English)
Occlusion boundaries (OBs) are pixel-level image boundaries corresponding to surface visibility discontinuities caused by occlusion. Through precise boundary localisation and occlusion orientation, OBs encode local surface layout and depth ordering, providing geometry-driven mid-level cues for scene understanding. However, progress in pixel-level OB estimation has been limited by fragmented supervision: Existing benchmarks often suffer from limited coverage, category-specific designs, missing self-occlusion annotations, or inconsistent annotation definitions. Meanwhile, modern edge detectors and monocular depth estimators have become strong boundary and geometry predictors, yet their relationship to definition-consistent OBs remains underexplored. We introduce RealOOB, a carefully annotated real-world benchmark with 4.26M definition-consistent, geometry-grounded OB labels covering both inter-object and self-occlusion boundaries, together with validity-aware occlusion-orientation maps that restrict supervision to pixels whose cross-boundary depth ordering is reliably measurable. Based on RealOOB, we evaluate forty OB estimators and edge detectors alongside six monocular depth estimators. Our evaluation reveals a clear gap in occlusion reasoning: modern edge detectors perform competitively with OB methods in localisation, whereas orientation prediction remains challenging for all evaluated methods. Meanwhile, even strong depth estimators often fail to exhibit measurable geometry at true OBs. We believe RealOOB provides a strong reference benchmark for the OB estimation community and a real-world testbed for assessing depth discontinuities and geometry fidelity in broader low-level vision tasks. Dataset and code will be released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。