让单目深度估计在反光表面更准,靠像素级反射检测提升鲁棒性。
Self-supervised Monocular Depth Estimation Robust to Reflective Surface Leveraged by Triplet Mining
- 用三元组挖掘定位反光区域,结合视角几何约束
- 反光区惩罚错误光度误差,非反光区保持精度
- 适合自动驾驶、机器人等需处理反光场景的项目
自监督单目深度估计(SSMDE)通过学习图像序列中的深度信息,无需真实深度标签即可预测密集深度图。然而,该方法在反光表面表现不佳,因违反朗伯反射假设导致训练失真。为此,本文提出一种新训练策略:利用三元组挖掘技术,在像素级定位反光区域,并基于不同视角间的相机几何关系进行引导。提出的反射感知三元组损失函数,专门惩罚反光区域的不当光度误差最小化,同时保留非反光区域的深度精度。此外,引入反射感知知识蒸馏方法,使学生模型可选择性学习反光与非反光区域的像素级知识。多个数据集上的评估结果表明,本方法显著提升了反光表面的深度质量,优于当前最先进的自监督单目深度估计基线。
原文摘要 · Abstract (English)
Self-supervised monocular depth estimation (SSMDE) aims to predict the dense depth map of a monocular image, by learning depth from RGB image sequences, eliminating the need for ground-truth depth labels. Although this approach simplifies data acquisition compared to supervised methods, it struggles with reflective surfaces, as they violate the assumptions of Lambertian reflectance, leading to inaccurate training on such surfaces. To tackle this problem, we propose a novel training strategy for an SSMDE by leveraging triplet mining to pinpoint reflective regions at the pixel level, guided by the camera geometry between different viewpoints. The proposed reflection-aware triplet mining loss specifically penalizes the inappropriate photometric error minimization on the localized reflective regions while preserving depth accuracy in non-reflective areas. We also incorporate a reflection-aware knowledge distillation method that enables a student model to selectively learn the pixel-level knowledge from reflective and non-reflective regions. This results in robust depth estimation across areas. Evaluation results on multiple datasets demonstrate that our method effectively enhances depth quality on reflective surfaces and outperforms state-of-the-art SSMDE baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。