多无人机协同吊挂负载,无需通信也能精准操控。
Decentralized Aerial Manipulation of a Cable-Suspended Load using Multi-Agent Reinforcement Learning
- 每架无人机独立决策,仅通过负载姿态间接协作。
- 实测实现与中心化方法相当的定位精度,支持失联一架仍稳定运行。
- 适合需要高可扩展性的无人系统团队应用。
本文提出首个在真实世界中实现多微型飞行器(MAVs)对缆绳悬挂负载进行6自由度操控的去中心化方法。该方法基于多智能体强化学习(MARL),为每架飞行器训练一个外环控制策略,无需全局状态、机间通信或邻近信息。智能体仅通过负载位姿观测实现隐式通信,具备高可扩展性与灵活性,并显著降低推理时计算开销,支持策略在机载端部署。此外,引入以线加速度和机体角速率作为动作空间的设计,结合鲁棒低层控制器,有效应对动态三维运动中由缆绳张力带来的不确定性,实现可靠的仿真到现实迁移。我们在多种真实实验中验证了该方法,包括负载模型不确定下的全姿态控制,其设定点跟踪性能达到当前最优集中式方法水平。还展示了异构控制策略下的协同能力及在飞行中完全失去一架无人机后的鲁棒性。实验视频见:https://autonomousrobots.nl/paper_websites/aerial-manipulation-marl
原文摘要 · Abstract (English)
This paper presents the first decentralized method to enable real-world 6-DoF manipulation of a cable-suspended load using a team of Micro-Aerial Vehicles (MAVs). Our method leverages multi-agent reinforcement learning (MARL) to train an outer-loop control policy for each MAV. Unlike state-of-the-art controllers that utilize a centralized scheme, our policy does not require global states, inter-MAV communications, nor neighboring MAV information. Instead, agents communicate implicitly through load pose observations alone, which enables high scalability and flexibility. It also significantly reduces computing costs during inference time, enabling onboard deployment of the policy. In addition, we introduce a new action space design for the MAVs using linear acceleration and body rates. This choice, combined with a robust low-level controller, enables reliable sim-to-real transfer despite significant uncertainties caused by cable tension during dynamic 3D motion. We validate our method in various real-world experiments, including full-pose control under load model uncertainties, showing setpoint tracking performance comparable to the state-of-the-art centralized method. We also demonstrate cooperation amongst agents with heterogeneous control policies, and robustness to the complete in-flight loss of one MAV. Videos of experiments: https://autonomousrobots.nl/paper_websites/aerial-manipulation-marl
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。