让多个机械臂在看不到彼此的情况下,靠隐式协作完成复杂操作。
Distilling Collaborative Dynamics into Latent Space for Implicit Coordination in Decentralized Multi-Agent Manipulation

- 将多智能体协同动态压缩到隐空间,每台机器只看自己视角
- 六项任务平均成功率38%,远超中心化方案的20%和无隐空间的9%
- 适合需要大规模分布式控制的真实场景,如工厂协作装配
多机械臂操作需精确时空协调,但多数中心化方法随团队规模扩大而性能下降。为此,我们提出CLS-DP框架,在无全局视野、无状态共享、无通信的条件下实现去中心化隐式协作。基于集中训练、分散执行(CTDE)范式,该方法将多智能体的特权动态信息提炼至隐空间。部署时,每个智能体仅凭局部RGB观测与共享任务指令生成协作隐变量,并将其用于扩散模型去噪过程。此设计使每台机器的计算开销与团队规模无关。在涵盖两到四台机器人、共六个RoboFactory基准任务中,CLS-DP实现38%的平均成功率,优于最佳中心化基线(20%)及无协作隐空间的去中心化变体(9%)。同时,所有配置下均保持优异参数效率。归因分析显示,受协作隐空间驱动的智能体,在执行过程中对自身及队友的关节与夹爪高度关注,表明所学隐变量能高效编码协同动态,实现在部分可观测环境下的有效隐式协作。
原文摘要 · Abstract (English)
Multi-arm manipulation demands precise spatiotemporal coordination, yet many centralized approaches scale poorly as team size increases. To address this, we propose CLS-DP, a decentralized multi-agent framework that enables implicit coordination under partial observability without shared global views, explicit state information, or inter-agent communication. Under the centralized training and decentralized execution (CTDE) paradigm, CLS-DP distills privileged multi-agent dynamics into a latent space. At deployment, each agent infers a collaborative latent from its local RGB observation and a shared task instruction; it then conditions the diffusion denoising process on this latent. This design enables implicit coordination with a per-agent cost independent of team size. Across six RoboFactory benchmark tasks spanning two to four agents, CLS-DP achieves a 38% mean success rate, outperforming the best centralized baseline (20%) and a decentralized ablation without the collaborative latent (9%). It also maintains superior parameter efficiency across all agent configurations. Attribution maps show that an agent conditioned on the collaborative latent places high attribution on the joints and grippers of both itself and its teammates throughout execution. This suggests that the learned latent efficiently encodes collaborative dynamics from local observation, which facilitates implicit coordination in realistic settings characterized by partial observability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。