用仿真训练的强化学习控制,让无人船精准抓取水面垃圾。
Sim-to-Real Transfer and Robustness Evaluation of Reinforcement Learning Control with Integrated Perception on an ASV for Floating Waste Capture

- 仿真中训练控制器,结合偏振相机感知实现垃圾定位
- 实测达厘米级精度,在14种干扰下表现稳定
- 适合做水上机器人自主捕捞系统的研发参考
用于清理水面漂浮垃圾的自主水面艇(ASV)在复杂水动力和外部干扰下运行,且水面感知挑战大。本文提出一个经过实地验证的系统,结合基于摄像头的偏振感知与轻量级深度强化学习(DRL)控制器,实现对漂浮垃圾的检测与捕获。摄像头检测结果转化为水面目标点,并由全程在仿真中训练的控制器进行跟踪,直接部署于改装后的ASV平台。主要贡献在于一种结合两阶段仿真协议与感知抽象模块的仿真到现实(sim-to-real)测试方法,该模块模拟真实相机行为,支持可复现的实地试验并明确评估仿真到现实的差距。我们在14种干扰场景下进行匹配的仿真与实地实验,暴露了失效模式并评估鲁棒性。结果表明系统达到厘米级终端精度,且在评估扰动条件下表现稳健;性能下降的主要原因是执行器模型保真度不足。我们还在真实环境中使用真实相机数据,完成了覆盖最大450平方米区域的搜寻-捕获任务。研究提炼出可靠迁移的关键经验:提升执行器模型精度、针对性域随机化,以及跨模块时延与时间戳的精细管理,同时指出现有挑战。
原文摘要 · Abstract (English)
Autonomous surface vessels for floating-waste removal operate under varying hydrodynamics, external disturbances, and challenging water-surface perception. We present a field-validated system that combines camera-based polarimetric perception with a lightweight DRL-based controller for floating-waste detection and capture. Camera detections are converted into water-surface target points and tracked by a controller trained entirely in simulation and deployed directly on a retrofitted ASV platform. Our main contribution is a sim-to-real testing methodology that combines a two-stage simulation protocol with a perception abstraction module designed to mimic real camera behavior, enabling reproducible field trials and explicit evaluation of the sim-to-real gap. We apply this framework in matched simulation and field experiments across 14 disturbance regimes to expose failure modes and evaluate robustness. The results show centimeter-level terminal accuracy and indicate robust control performance under the evaluated perturbation regimes. The main source of degradation is insufficient actuation-model fidelity. We also demonstrate the system in a search-and-capture application using real camera detections in real-world conditions over areas of up to $450~m^2$. The study distills practical lessons for reliable transfer, including improved actuation-model fidelity, targeted domain randomization, and careful management of latency and timestamps across modules, while highlighting remaining challenges.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。