arXiv:2410.10684cs.RO2024-10被引 1

用自适应路径规划减少机器人视觉标注成本,提升未知环境感知能力

Active Learning of Robot Vision Using Adaptive Path Planning

  • 结合人工标注与自动伪标签,动态规划采集路径
  • 仅需少量人工标注即达接近全监督的分割性能
  • 适合需要高效数据收集的野外机器人任务

机器人需要鲁棒且灵活的视觉系统以理解环境,超越几何信息。现有系统多基于深度学习,但在初始未知环境中,依赖静态数据集预训练会限制视觉表现。当前自监督与全监督主动学习方法虽有进展,但需大量领域内预训练数据或人力标注。为此,本文提出一种自适应规划框架,用于高效采集训练数据,显著降低语义地形监测任务中的人工标注需求。通过融合高质量人工标注与自动生成的伪标签,实验表明该框架在大幅减少人工标注量的同时,分割性能接近全监督方法,且优于纯自监督方法。本文还讨论了现有方法的优劣,并展望了未来在未知环境中构建更鲁棒、灵活机器人视觉系统的方向。

原文摘要 · Abstract (English)

Robots need robust and flexible vision systems to perceive and reason about their environments beyond geometry. Most of such systems build upon deep learning approaches. As autonomous robots are commonly deployed in initially unknown environments, pre-training on static datasets cannot always capture the variety of domains and limits the robot's vision performance during missions. Recently, self-supervised as well as fully supervised active learning methods emerged to improve robotic vision. These approaches rely on large in-domain pre-training datasets or require substantial human labelling effort. To address these issues, we present a recent adaptive planning framework for efficient training data collection to substantially reduce human labelling requirements in semantic terrain monitoring missions. To this end, we combine high-quality human labels with automatically generated pseudo labels. Experimental results show that the framework reaches segmentation performance close to fully supervised approaches with drastically reduced human labelling effort while outperforming purely self-supervised approaches. We discuss the advantages and limitations of current methods and outline valuable future research avenues towards more robust and flexible robotic vision systems in unknown environments.

主动学习机器人视觉路径规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。