用渐进式学习提升单目视觉里程计的鲁棒性,适应复杂场景。
Robust Monocular Visual Odometry using Curriculum Learning
- 按轨迹运动特性评估样本难度,逐步增加训练复杂度。
- 在TartanAir、EuRoC等数据集上优于现有最先进方法。
- 适合需要高鲁棒性的机器人导航场景使用。
受人类和动物自然学习模式启发,课程学习(CL)通过逐步引入更复杂的训练数据来系统性提升模型性能。本文将创新的课程学习方法应用于单目视觉里程计(VO)这一具有挑战性的几何估计问题,旨在突破当前最先进(SOTA)基准。通过在端到端的Deep-Patch-Visual Odometry(DPVO)框架中集成新型课程学习策略,我们构建了更具鲁棒性的模型,可在复杂环境和运动场景中保持高性能。提出的方法包括基于轨迹运动特征评估样本难度、采用自适应加权损失实现动态调度,并利用强化学习代理动态调整训练重点。在多样化的合成数据集TartanAir及真实世界复杂基准数据集EuRoC和TUM-RGBD上的全面评估表明,所提出的课程学习型深度斑块视觉里程计(CL-DPVO)显著优于现有最先进方法,涵盖基于特征与学习型的各类方案,验证了将课程学习融入视觉里程计系统的有效性。
原文摘要 · Abstract (English)
Curriculum Learning (CL), drawing inspiration from natural learning patterns observed in humans and animals, employs a systematic approach of gradually introducing increasingly complex training data during model development. Our work applies innovative CL methodologies to address the challenging geometric problem of monocular Visual Odometry (VO) estimation, which is essential for robot navigation in constrained environments. The primary objective of our research is to push the boundaries of current state-of-the-art (SOTA) benchmarks in monocular VO by investigating various curriculum learning strategies. We enhance the end-to-end Deep-Patch-Visual Odometry (DPVO) framework through the integration of novel CL approaches, with the goal of developing more resilient models capable of maintaining high performance across challenging environments and complex motion scenarios. Our research encompasses several distinctive CL strategies. We develop methods to evaluate sample difficulty based on trajectory motion characteristics, implement sophisticated adaptive scheduling through self-paced weighted loss mechanisms, and utilize reinforcement learning agents for dynamic adjustment of training emphasis. Through comprehensive evaluation on the diverse synthetic TartanAir dataset and complex real-world benchmarks such as EuRoC and TUM-RGBD, our Curriculum Learning-based Deep-Patch-Visual Odometry (CL-DPVO) demonstrates superior performance compared to existing SOTA methods, including both feature-based and learning-based VO approaches. The results validate the effectiveness of integrating curriculum learning principles into visual odometry systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。