arXiv:2410.20220cs.ROcs.AI2024-10综述被引 27

综述神经场在机器人感知与决策中的应用,解析其高效建模优势。

Neural Fields in Robotics: A Survey

  • 系统梳理四类神经场框架,涵盖占据、距离场、辐射场与高斯点云
  • 覆盖机器人五大领域应用,实现姿态估计到自动驾驶的全链路建模
  • 揭示可微性与轻量化优势,适合实时交互与生成式任务

神经场已成为计算机视觉与机器人领域三维场景表征的革新方法,能从带位姿的二维数据中准确推断几何结构、三维语义与动态信息。借助可微渲染,神经场融合连续隐式与显式神经表示,实现高保真三维重建、多模态传感器数据融合及新视角生成。本文综述其在机器人中的应用,强调其在感知、规划与控制方面的潜力。其紧凑性、内存效率与可微特性,以及与基础模型和生成模型的无缝集成,使其适用于实时应用,提升机器人适应性与决策能力。基于200余篇论文,本文系统分类神经场在机器人中的应用,评估其优劣,并讨论关键挑战与未来方向。首先介绍四类核心框架:占据网络、符号距离场、神经辐射场与高斯点阵;其次详述其在姿态估计、操作、导航、物理建模与自动驾驶等五大领域的应用,提炼代表性工作与启示;最后分析当前局限并提出未来研究方向。

原文摘要 · Abstract (English)

Neural Fields have emerged as a transformative approach for 3D scene representation in computer vision and robotics, enabling accurate inference of geometry, 3D semantics, and dynamics from posed 2D data. Leveraging differentiable rendering, Neural Fields encompass both continuous implicit and explicit neural representations enabling high-fidelity 3D reconstruction, integration of multi-modal sensor data, and generation of novel viewpoints. This survey explores their applications in robotics, emphasizing their potential to enhance perception, planning, and control. Their compactness, memory efficiency, and differentiability, along with seamless integration with foundation and generative models, make them ideal for real-time applications, improving robot adaptability and decision-making. This paper provides a thorough review of Neural Fields in robotics, categorizing applications across various domains and evaluating their strengths and limitations, based on over 200 papers. First, we present four key Neural Fields frameworks: Occupancy Networks, Signed Distance Fields, Neural Radiance Fields, and Gaussian Splatting. Second, we detail Neural Fields' applications in five major robotics domains: pose estimation, manipulation, navigation, physics, and autonomous driving, highlighting key works and discussing takeaways and open challenges. Finally, we outline the current limitations of Neural Fields in robotics and propose promising directions for future research. Project page: https://robonerf.github.io

神经场机器人3D重建可微渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。