用合成图像提升水下机器人检测垃圾的准确率
IBURD: Image Blending for Underwater Robotic Detection
- 通过泊松编辑与风格迁移融合垃圾与真实海底背景
- 生成带像素级标注的逼真水下垃圾图像
- 适合水下视觉检测与环保机器人研究者使用
我们提出一种图像合成流程 IBURD,用于生成逼真的合成图像,以辅助水下自主航行器(AUV)在海洋垃圾检测任务中训练深度检测模型。IBURD 利用垃圾物体源图像及其标注,结合目标海洋环境背景图,通过泊松编辑和风格迁移技术,实现透明物体在任意背景上的鲁棒融合,并基于目标背景模糊度自动调整合成图像风格。该方法生成的具有真实水下背景的垃圾图像,有效缓解了深度学习视觉算法在复杂水下环境中面临的数据稀缺与数据多样性不足问题,可支持 AUV 执行环境清理任务。定量分析与机器人实测均验证了 IBURD 在水下垃圾检测中的有效性。
原文摘要 · Abstract (English)
We present an image blending pipeline, \textit{IBURD}, that creates realistic synthetic images to assist in the training of deep detectors for use on underwater autonomous vehicles (AUVs) for marine debris detection tasks. Specifically, IBURD generates both images of underwater debris and their pixel-level annotations, using source images of debris objects, their annotations, and target background images of marine environments. With Poisson editing and style transfer techniques, IBURD is even able to robustly blend transparent objects into arbitrary backgrounds and automatically adjust the style of blended images using the blurriness metric of target background images. These generated images of marine debris in actual underwater backgrounds address the data scarcity and data variety problems faced by deep-learned vision algorithms in challenging underwater conditions, and can enable the use of AUVs for environmental cleanup missions. Both quantitative and robotic evaluations of IBURD demonstrate the efficacy of the proposed approach for robotic detection of marine debris.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。