用物理仿真优化技能组合,让机器人高效完成复杂长程操作。
MOSAIC: Skill-Centric Manipulation Planning with Physics Simulation
- 通过物理仿真评估技能执行效果,智能选择高成功率技能
- 构建生成器与连接器双机制,突破传统规划的路径盲区
- 适合需要灵活组合技能的通用机器人任务研究者
在机器人领域,利用预设技能规划长时序操作是一个核心挑战;高效解决此问题可使通用机器人通过灵活组合通用技能应对新任务。该问题的解存在于无限庞大的参数化技能序列空间中——常规增量方法难以发现具有非明显中间步骤的序列。部分方法在低维符号空间推理,虽更易探索但易失效且构建成本高。本文提出MOSAIC,一种以技能为中心、多方向规划的方法,通过物理仿真评估技能执行结果,判断使用何种技能及其最可能成功的区域。MOSAIC采用两类互补技能:生成器识别技能有效性的“能力岛屿”,连接器则通过求解边界值问题链接这些技能轨迹。聚焦高成功率区域,MOSAIC高效发现物理可行解。我们在仿真和真实世界中验证了其在复杂长时序任务上的有效性,涵盖生成式扩散模型、运动规划算法及专用操作模型等多种技能。相关演示见 skill-mosaic.github.io。
原文摘要 · Abstract (English)
Planning long-horizon manipulation motions using a set of predefined skills is a central challenge in robotics; solving it efficiently could enable general-purpose robots to tackle novel tasks by flexibly composing generic skills. Solutions to this problem lie in an infinitely vast space of parameterized skill sequences -- a space where common incremental methods struggle to find sequences that have non-obvious intermediate steps. Some approaches reason over lower-dimensional, symbolic spaces, which are more tractable to explore but may be brittle and are laborious to construct. In this work, we introduce MOSAIC, a skill-centric, multi-directional planning approach that targets these challenges by reasoning about which skills to employ and where they are most likely to succeed, by utilizing physics simulation to estimate skill execution outcomes. Specifically, MOSAIC employs two complementary skill families: Generators, which identify ``islands of competence'' where skills are demonstrably effective, and Connectors, which link these skill-trajectories by solving boundary value problems. By focusing planning efforts on regions of high competence, MOSAIC efficiently discovers physically-grounded solutions. We demonstrate its efficacy on complex long-horizon problems in both simulation and the real world, using a diverse set of skills including generative diffusion models, motion planning algorithms, and manipulation-specific models. Visit skill-mosaic.github.io for demonstrations and examples.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。