arXiv:2502.10842cs.CVcs.RO2025-02被引 5

让机器人移动中也能高精度扫描物体表面,无需复杂校准。

Mobile Robotic Multi-View Photometric Stereo

  • 用增量学习预测每视角法向、深度和不确定性,实时优化结果。
  • 在DiLiGenT数据集上比顶尖方法快近百倍,仍保持相似精度。
  • 适合移动机器人快速建模,尤其对反射特性未知的物体有效。

多视角光度立体(MVPS)是获取物体精细三维结构的常用方法。传统方法需固定光源与相机,难以用于移动平台。为此,本文提出一种新型移动机器人系统实现MVPS。该系统带来新算法挑战,本文进一步提出增量式处理方案:通过监督学习预测每视角表面法向、深度及像素级不确定性;再基于提出的MVPS优化问题生成精细化深度图;最后结合相机位姿跟踪,融合多视角深度图,恢复全局一致的物体三维几何结构。实验表明,该方法可在较少图像下实现高频表面细节还原,且全局形状一致,适用于反射特性未知物体。相比现有最优方法[1,2],计算速度提升近100倍,在DiLiGenT基准数据集[3]上性能相当。

原文摘要 · Abstract (English)

Multi-View Photometric Stereo (MVPS) is a popular method for fine-detailed 3D acquisition of an object from images. Despite its outstanding results on diverse material objects, a typical MVPS experimental setup requires a well-calibrated light source and a monocular camera installed on an immovable base. This restricts the use of MVPS on a movable platform, limiting us from taking MVPS benefits in 3D acquisition for mobile robotics applications. To this end, we introduce a new mobile robotic system for MVPS. While the proposed system brings advantages, it introduces additional algorithmic challenges. Addressing them, in this paper, we further propose an incremental approach for mobile robotic MVPS. Our approach leverages a supervised learning setup to predict per-view surface normal, object depth, and per-pixel uncertainty in model-predicted results. A refined depth map per view is obtained by solving an MVPS-driven optimization problem proposed in this paper. Later, we fuse the refined depth map while tracking the camera pose w.r.t the reference frame to recover globally consistent object 3D geometry. Experimental results show the advantages of our robotic system and algorithm, featuring the local high-frequency surface detail recovery with globally consistent object shape. Our work is beyond any MVPS system yet presented, providing encouraging results on objects with unknown reflectance properties using fewer frames without a tiring calibration and installation process, enabling computationally efficient robotic automation approach to photogrammetry. The proposed approach is nearly 100 times computationally faster than the state-of-the-art MVPS methods such as [1, 2] while maintaining the similar results when tested on subjects taken from the benchmark DiLiGenT MV dataset [3].

三维重建移动机器人光度立体实时建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。