仅用一张图快速构建高精度神经表面,助力机器人路径规划
Efficient Construction of Implicit Surface Models From a Single Image for Motion Generation
- 用轻量级哈希网格编码器+预训练模型,实现单图快速建模
- 训练仅需数秒,重建精度和收敛速度均优于现有方法
- 适合机器人表面跟随、实时场景建模等应用
隐式表示广泛应用于机器人避障与路径规划。本文研究从单张图像构建隐式距离表示的问题。以往方法如NeuS及其变体通常需要大量多视角图像输入,且训练时间长。本文提出FINS框架,仅需单张或少量图像即可高效重建高保真表面与SDF场。FINS结合多分辨率哈希网格编码器与轻量级几何/颜色头,通过近似二阶优化器实现快速训练,数秒内即可收敛。我们利用预训练基础模型从图像中推断几何信息,仅凭单张RGB图像即完成神经表面构建。实验表明,在相同条件下,本方法在表面重建与SDF估计上的收敛速度和精度均超越当前最优基线。此外,我们验证了FINS在机器人表面跟随任务中的适用性,并展示了其在多个基准数据集上的可扩展性。代码已开源。
原文摘要 · Abstract (English)
Implicit representations have been widely applied in robotics for obstacle avoidance and path planning. In this paper, we explore the problem of constructing an implicit distance representation from a single image. Past methods for implicit surface reconstruction, such as NeuS and its variants generally require a large set of multi-view images as input, and require long training times. In this work, we propose Fast Image-to-Neural Surface (FINS), a lightweight framework that can reconstruct high-fidelity surfaces and SDF fields based on a single or a small set of images. FINS integrates a multi-resolution hash grid encoder with lightweight geometry and color heads, making the training via an approximate second-order optimizer highly efficient and capable of converging within a few seconds. Additionally, we achieve the construction of a neural surface requiring only a single RGB image, by leveraging pre-trained foundation models to estimate the geometry inherent in the image. Our experiments demonstrate that under the same conditions, our method outperforms state-of-the-art baselines in both convergence speed and accuracy on surface reconstruction and SDF field estimation. Moreover, we demonstrate the applicability of FINS for robot surface following tasks and show its scalability to a variety of benchmark datasets. Code is publicly available at https://github.com/waynechu1109/FINS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。