arXiv:2409.16215cs.ROcs.CV2024-09中稿 · Journal of Intelli…被引 5

为微型机器人设计的持续学习检测数据集与评测基准

TiROD: Tiny Robotics Dataset and Benchmark for Continual Object Detection

  • 构建小型机器人自拍视频数据集,覆盖多领域、多类别
  • 在低分辨率噪声图像上测试轻量级模型,验证持续学习效果
  • 适合研究嵌入式视觉与持续学习的开发者参考

视觉感知对移动机器人应用至关重要,但其常面临训练域与实际部署域不一致的问题,需具备持续适应能力。微型机器人受限于体积、功耗和算力,在低分辨率和噪声图像上运行检测模型尤为困难。为此,本文提出一个面向微型机器人平台的视觉持续学习基准:(i) TiROD数据集,由小型移动机器人搭载摄像头采集,用于评估检测器在多域、多类场景下的表现;(ii) 基于NanoDet轻量级实时检测器,在该数据集上对多种持续学习策略进行系统评测。结果揭示了微型机器人中实现鲁棒高效持续学习的关键挑战。

原文摘要 · Abstract (English)

Detecting objects with visual sensors is crucial for numerous mobile robotics applications, from autonomous navigation to inspection. However, robots often need to operate under significant domains shifts from those they were trained in, requiring them to adjust to these changes. Tiny mobile robots, subject to size, power, and computational constraints, face even greater challenges when running and adapting detection models on low-resolution and noisy images. Such adaptability, though, is crucial for real-world deployment, where robots must operate effectively in dynamic and unpredictable settings. In this work, we introduce a new vision benchmark to evaluate lightweight continual learning strategies tailored to the unique characteristics of tiny robotic platforms. Our contributions include: (i) Tiny Robotics Object Detection~(TiROD), a challenging video dataset collected using the onboard camera of a small mobile robot, designed to test object detectors across various domains and classes; (ii) a comprehensive benchmark of several continual learning strategies on different scenarios using NanoDet, a lightweight, real-time object detector for resource-constrained devices.. Our results highlight some key challenges in developing robust and efficient continual learning strategies for object detectors in tiny robotics.es; (ii) a benchmark of different continual learning strategies on this dataset using NanoDet, a lightweight object detector. Our results highlight key challenges in developing robust and efficient continual learning strategies for object detectors in tiny robotics.

持续学习机器人感知轻量化检测数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。