无需标注数据,机器人可实时学习如何判断地形是否可通行。
Self-Supervised Online Robot-Agnostic Traversability Estimation for Open-World Environments

- 用传感器数据在线生成通用地形评分,不依赖特定机器人。
- 通过视觉与实时评分对齐,提升视觉导航的准确性。
- 内存开销小,适合部署在机器人上,还能跨平台迁移使用。
自监督在线可通行性估计使机器人能从无标签的开放世界经验中持续学习,并适应安全高效的路径规划。现有方法或依赖人工设计的本体感知评分,限制了通用性;或基于历史数据聚类,无法支持在线学习。此外,许多持续学习方法计算和存储开销大,难以在机载设备部署。我们提出COTRATE,一种从多模态、无标签机器人经验中实现连续可通行性估计的在线学习框架。首先,通过一个不依赖机器人的学习型在线地形评估模块,利用本体感知与惯性信号推断出鲁棒的可通行性评分;随后,采用新颖的对齐损失,将视觉特征嵌入与在线地形评估结果关联,以监督视觉可通行性网络。为在持续学习中最小化遗忘且保持低开销,我们提出一种多样性感知的特征选择策略,仅用紧凑的回放记忆维持性能。进一步实验表明,所学可通行性表征可有效支持不同运动学结构的机器人平台间知识迁移。我们在两个机器人平台于11种户外地形采集的约5万张图像数据集上评估COTRATE,对比其在三个典型户外环境中的导航任务表现。数据集、代码与训练模型已公开。
原文摘要 · Abstract (English)
Self-supervised online traversability estimation enables robots to continuously learn from unlabeled open-world experiences and adapt their navigation behavior toward safe and efficient trajectories. Existing approaches either rely on handcrafted proprioceptive traversability scores, limiting robot-agnosticism, or cluster prior data, preventing online learning. Moreover, many continual learning methods incur substantial memory and computational costs, hindering onboard deployment. We introduce COTRATE, an online learning framework for continuous traversability estimation from multimodal, unlabeled robot experience. Our method first infers robust traversability scores using a robot-agnostic, learning-based online terrain assessment module operating on proprioceptiveand inertial signals. These scores then supervise a visual traversability network through a novel alignment loss that associates visual embeddings with online terrain assessments. To mitigate forgetting during continual learning with minimal overhead, we propose a diversity-aware feature selection strategythat preserves performance using a compact replay memory. We further show that the learned traversability representation supports knowledge transfer across different robot platforms with different locomotion kinematics. We evaluate COTRATE on a dataset of $\approx$ 50,000 images collected with two robotic platforms across 11 outdoor terrains, and benchmark it on navigation tasks in three representative outdoor environments. We make the dataset, code, and trained models publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。