arXiv:2605.05236cs.ROcs.AI2026-05

用拓扑驱动的多智能体强化学习,让软机器人在复杂环境不缠绕。

Topology-Driven Anti-Entanglement Control for Soft Robots

论文配图:Topology-Driven Anti-Entanglement Control for Soft Robots
图 1 · 摘自论文原文
  • 基于拓扑状态共享实现集中式学习,缓解多机交互带来的训练不稳。
  • 分布式执行避免通信开销,提升系统可靠性,实验收敛速度更快。
  • 引入拓扑不变量评估缠绕风险,适合高密度约束场景下的协同控制。

在复杂受限环境下,软机器人在精密制造中的作用日益突出,基于多智能体强化学习的防缠绕控制成为研究热点。当前核心挑战在于如何协调多机器人在高密度障碍与不稳定环境中完成解缠操作。现有分布式训练框架在高密度障碍和动态环境下存在可观测性难题,导致学习效果不佳。本文提出拓扑驱动的多智能体强化学习(TD-MARL)框架,通过集中式学习使各智能体共享拓扑状态,感知彼此策略,缓解复杂交互引发的训练不稳;通过分布式执行消除机器人间通信需求,提升系统可靠性;引入拓扑安全层,利用拓扑不变量精准评估并抑制缠绕风险,防止策略陷入局部困境。真实仿真环境下的全量实验表明,该方法在收敛性和防缠绕效果上优于当前先进深度强化学习方法。

原文摘要 · Abstract (English)

In the field of precision manufacturing in complex constrained environments, the role of soft robots is increasingly prominent, and the realization of anti-winding control based on multi-intelligent body reinforcement learning has become a research hotspot. One of the core problems at present is to coordinate multiple robots to complete the unwinding operation in a highly constrained environment. The existing distributed training framework faces some observability challenges in high-density barrier and unstable environments, resulting in poor learning results. This paper proposes a topology-driven Multi-Agent Reinforcement Learning (TD-MARL) framework to coordinate multi-robot systems to avoid entanglement. Specifically, the critical network adopts centralized learning, so that each intelligent body can perceive the strategies of other intelligent bodies by sharing the topological state, thus alleviating the training instability caused by complex interactions; eliminating the demand for communication resources between robots through distributed execution, Upgrade system reliability; the integrated topological security layer uses topological invariants to accurately assess and mitigate the risk of entanglement to avoid the strategy from falling into local difficulties. Finally, the full simulation experiments carried out in the real simulation environment show that the method is better than the current advanced deep reinforcement learning (DRL) method in terms of convergence and anti-winding effect.

软体机器人强化学习多智能体防缠绕

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。