arXiv:2508.01014cs.ROcs.CV2025-08中稿 · the IEEE/CVF Winte…被引 3

Hestia提升3D重建的视角规划效率,自动选最优拍摄位置。

Hestia: Voxel-Face-Aware Hierarchical Next-Best-View Acquisition for Efficient 3D Reconstruction

  • 分层结构+面感知设计,智能选择下一张最佳照片视角。
  • 覆盖率提升至少4%,点云误差减少50%,支持实时推理。
  • 适合机器人自主建模、工业检测等真实场景应用。

三维重建与新视角合成技术已实现高效逼真的渲染,但图像采集仍依赖人工或简单预设轨迹。现有通用视角规划方法虽无需在线学习,但在不同物体上表现不稳定。本文提出面向五自由度视角预测的分层式自适应视角获取框架Hestia,通过四个改进:更丰富的数据集增强鲁棒性、分层结构应对高维连续动作空间、近邻贪婪策略缓解虚假关联、面感知设计避免几何遗漏。实验表明,Hestia在覆盖率上至少提升4%,点云距离(Chamfer Distance)降低50%,且保持实时推理。在仅5张图像预算下,覆盖率优于先前方法至少12%,对物体位置变化也保持稳定。结果证明Hestia可应用于真实世界场景。

原文摘要 · Abstract (English)

Advances in 3D reconstruction and novel view synthesis have enabled efficient and photorealistic rendering. However, images for reconstruction are still either largely manual or constrained by simple preplanned trajectories. To address this issue, recent works propose generalizable next-best-view planners that do not require online learning. Nevertheless, robustness and performance remain limited across various shapes. Hence, this study introduces Voxel-Face-Aware Hierarchical Next-Best-View Acquisition for Efficient 3D Reconstruction (Hestia), which addresses the shortcomings of the reinforcement learning-based generalizable approaches for five-degree-of-freedom viewpoint prediction. Hestia systematically improves the planners through four components: a more diverse dataset to promote robustness, a hierarchical structure to manage the high-dimensional continuous action search space, a close-greedy strategy to mitigate spurious correlations, and a face-aware design to avoid overlooking geometry. Experimental results show that Hestia achieves non-marginal improvements, with at least a 4% gain in coverage ratio, while reducing Chamfer Distance by 50% and maintaining real-time inference. In addition, Hestia outperforms prior methods by at least 12% in coverage ratio with a 5-image budget and remains robust to object placement variations. Finally, we demonstrate that Hestia, as a next-best-view planner, is feasible for the real-world application. Our project page is https://johnnylu305.github.io/hestia web.

3D重建视角规划机器人视觉

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。