arXiv:2412.10444cs.CVcs.RO2024-12被引 6

提出一种新视角选择策略,让机器人扫描时自动探索点云边界,提升效率和覆盖质量。

Boundary Exploration of Next Best View Policy in 3D Robotic Scanning

  • 以点云边界为探索目标,自然考虑视角重叠,无需固定相机位置。
  • 在多个数据集上实现更高扫描覆盖率和更稳定的重叠控制。
  • 提供模型驱动与学习驱动两种方法,后者速度更快且不依赖参考模型。

Next Best View(NBV)问题是3D机器人扫描中的核心挑战,直接影响物体捕获与重建的效率。现有方法常忽略视角重叠、假设相机有固定虚拟原点,并依赖体素化3D表示。为此,本文提出一种基于边界探索的NBV策略,主动寻找已扫描点云的边界区域,同时内建重叠处理机制。相机工作距离可由用户定义且全程保持灵活。首先,设计一种基于模型的方法,通过参考模型迭代生成候选视角,采用兼顾重叠与收敛性的评分策略。其次,提出边界探索型NBV网络(BENBV-Net),直接从扫描数据预测最佳视角,无需参考模型。该网络对候选边界进行打分,选取得分最高者作为下一次视点。BENBV-Net在保持模型方法性能的同时,显著提升生成速度。我们在ShapeNet、ModelNet和3D Repository数据集上评估,结果表明本方法在扫描效率、最终覆盖率和重叠稳定性方面均优于现有方法,对实际3D扫描应用具有重要意义。相关代码已开源:github.com/leihui6/BENBV。

原文摘要 · Abstract (English)

The Next Best View (NBV) problem is a pivotal challenge in 3D robotic scanning, with the potential to significantly improve the efficiency of object capture and reconstruction. Existing methods for determining the NBV often overlook view overlap, assume a fixed virtual origin for the camera, and rely on voxel-based representations of 3D data. To address these limitations and enhance the practicality of scanning unknown objects, we propose an NBV policy in which the next view explores the boundary of the scanned point cloud, with overlap intrinsically considered. The scanning or working distance of the camera is user-defined and remains flexible throughout the process. To this end, we first introduce a model-based approach in which candidate views are iteratively proposed based on a reference model. Scores are computed using a carefully designed strategy that accounts for both view overlap and convergence. In addition, we propose a learning-based method, the Boundary Exploration NBV Network (BENBV-Net), which predicts the NBV directly from the scanned data without requiring a reference model. BENBV-Net estimates scores for candidate boundaries, selecting the one with the highest score as the target for the next best view. It offers a significant improvement in NBV generation speed while maintaining the performance level of the model-based approach. We evaluate both methods on the ShapeNet, ModelNet, and 3D Repository datasets. Experimental results demonstrate that our approach outperforms existing methods in terms of scanning efficiency, final coverage, and overlap stability, all of which are critical for practical 3D scanning applications. The related code is available at github.com/leihui6/BENBV.

3D扫描视觉规划机器人点云

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。