用生成模型统一规划多机器人协同推移多个物体。
Collaborative Multi-Robot Non-Prehensile Manipulation via Flow-Matching Co-Generation
- 通过流匹配联合生成接触点与操作轨迹。
- 在复杂模拟环境中优于基线方法,成功率更高。
- 适合需要大规模多机器人协作的场景。
在杂乱环境中协调多个机器人重新定位多个物体,需同时推理机器人接触位置、操作方式及安全高效导航。现有方法或全端到端学习,或依赖先验信息与手工设计规划器,难以应对长时程任务中多样物体。本文提出统一框架,结合流匹配共生成与匿名多机器人运动规划,使生成模型从视觉观测中联合生成接触构型与操作轨迹,新型规划器实现机器人规模化调度,并在对象层面分配目标结构,统一机器人与对象级推理。实验表明,该方法在挑战性模拟环境中优于基线,在运动规划与操作任务中均表现更优,凸显生成式协同设计与集成规划对复杂多智能体、多物体协作的可扩展性优势。代码与演示见 gco-paper.github.io。
原文摘要 · Abstract (English)
Coordinating a team of robots to reposition multiple objects in cluttered environments requires reasoning jointly about where robots should establish contact, how to manipulate objects once contact is made, and how to navigate safely and efficiently at scale. Prior approaches typically fall into two extremes -- either learning the entire task or relying on privileged information and hand-designed planners -- both of which struggle to handle diverse objects in long-horizon tasks. To address these challenges, we present a unified framework for collaborative multi-robot, multi-object non-prehensile manipulation that integrates flow-matching co-generation with anonymous multi-robot motion planning. Within this framework, a generative model co-generates contact formations and manipulation trajectories from visual observations, while a novel motion planner conveys robots at scale. Crucially, the same planner also supports coordination at the object level, assigning manipulated objects to larger target structures and thereby unifying robot- and object-level reasoning within a single algorithmic framework. Experiments in challenging simulated environments demonstrate that our approach outperforms baselines in both motion planning and manipulation tasks, highlighting the benefits of generative co-design and integrated planning for scaling collaborative manipulation to complex multi-agent, multi-object settings. Visit gco-paper.github.io for code and demonstrations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。