arXiv:2503.02752cs.ROcs.CV2025-03ICRA被引 2

用微型机器人集群+深度学习,实现水下危险环境的高精度视觉监控。

Deep Learning-Enhanced Visual Monitoring in Hazardous Underwater Environments with a Swarm of Micro-Robots

  • 融合仿真数据与多模态网络,预测漂移旋转下的机器人坐标。
  • 坐标预测准确率高,拼接图像清晰连贯,抗干扰能力强。
  • 适合水下设施巡检、灾害监测等高风险场景应用。

长期监测极端环境(如水下储藏设施)成本高、耗人力且危险。利用低成本协同机器人自动化该过程可显著提升效率。这些机器人从不同位置拍摄图像,需同步处理以构建设施的时空模型。本文提出一种新方法,整合数据仿真、用于坐标预测的多模态深度学习网络以及图像重组装技术,应对环境扰动导致的机器人位置与朝向漂移和旋转问题。该方法通过融合快照中的视觉信息、掩码提供的全局位置上下文及噪声坐标,提升了嘈杂环境下的对齐精度。我们通过大量模拟真实水下机器人作业的合成数据验证了该方法。结果表明,坐标预测精度极高,图像拼接效果自然合理,证实了方法在现实场景中的适用性。拼接后的图像为有效监测与检查提供了清晰连贯的视图,展现出在极端环境中的广泛应用潜力,进一步推动了高危领域监测的安全性、效率与成本优化。代码已开源:https://github.com/ChrisChen1023/Micro-Robot-Swarm。

原文摘要 · Abstract (English)

Long-term monitoring and exploration of extreme environments, such as underwater storage facilities, is costly, labor-intensive, and hazardous. Automating this process with low-cost, collaborative robots can greatly improve efficiency. These robots capture images from different positions, which must be processed simultaneously to create a spatio-temporal model of the facility. In this paper, we propose a novel approach that integrates data simulation, a multi-modal deep learning network for coordinate prediction, and image reassembly to address the challenges posed by environmental disturbances causing drift and rotation in the robots' positions and orientations. Our approach enhances the precision of alignment in noisy environments by integrating visual information from snapshots, global positional context from masks, and noisy coordinates. We validate our method through extensive experiments using synthetic data that simulate real-world robotic operations in underwater settings. The results demonstrate very high coordinate prediction accuracy and plausible image assembly, indicating the real-world applicability of our approach. The assembled images provide clear and coherent views of the underwater environment for effective monitoring and inspection, showcasing the potential for broader use in extreme settings, further contributing to improved safety, efficiency, and cost reduction in hazardous field monitoring. Code is available on https://github.com/ChrisChen1023/Micro-Robot-Swarm.

水下监控机器人集群深度学习图像拼接

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。