用视觉+物理符号模型,让机器人在复杂地形自主导航。
AnyNav: Visual Neuro-Symbolic Friction Learning for Off-road Navigation
- 结合神经网络感知与物理模型推理,实现视觉引导的摩擦力估计。
- 在多种四轮车和野外环境中实现从仿真到现实的无缝迁移。
- 适合需要强泛化能力的野外机器人导航任务。
非结构化环境下的越野导航对行星探测、灾后救援等机器人应用至关重要,但因地形-车辆相互作用复杂且难以建模而长期面临挑战。传统物理方法难以捕捉非线性动力学,纯数据驱动方法则易过拟合特定运动模式、车辆几何或平台。为此,我们提出AnyNav,一种基于神经符号原则的视觉摩擦力估计与导航框架。该方法融合神经网络的视觉感知与符号物理模型的动态推理,并采用双层优化的自监督学习范式,在真实场景中通过物理优化训练摩擦力网络。显式引入物理推理显著提升了跨地形、车辆类型及工况的泛化能力。基于预测的摩擦系数,进一步构建了物理约束的导航系统,可生成物理可行且高效的时间-路径与速度规划。实验证明,AnyNav可无缝迁移至真实机器人平台,在多种四轮车和多样化野外环境中展现出强鲁棒性。
原文摘要 · Abstract (English)
Off-road navigation is critical for a wide range of field robotics applications from planetary exploration to disaster response. However, it remains a longstanding challenge due to unstructured environments and the inherently complex terrain-vehicle interactions. Traditional physics-based methods struggle to accurately capture the nonlinear dynamics underlying these interactions, while purely data-driven approaches often overfit to specific motion patterns, vehicle geometries, or platforms, limiting their generalization in diverse, real-world scenarios. To address these limitations, we introduce AnyNav, a vision-based friction estimation and navigation framework grounded in neuro-symbolic principles. Our approach integrates neural networks for visual perception with symbolic physical models for reasoning about terrain-vehicle dynamics. To enable self-supervised learning in real-world settings, we adopt the imperative learning paradigm, employing bilevel optimization to train the friction network through physics-based optimization. This explicit incorporation of physical reasoning substantially enhances generalization across terrains, vehicle types, and operational conditions. Leveraging the predicted friction coefficients, we further develop a physics-informed navigation system capable of generating physically feasible, time-efficient paths together with corresponding speed profiles. We demonstrate that AnyNav seamlessly transfers from simulation to real-world robotic platforms, exhibiting strong robustness across different four-wheeled vehicles and diverse off-road environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。