同时优化机器人的外形与行为,让集群在洪灾救援中更高效。
A Talent-infused Policy-gradient Approach to Efficient Co-Design of Morphology and Task Allocation Behavior of Multi-Robot Systems
- 用能力图谱分解问题,将外形与行为协同设计
- 在洪灾救援任务中性能超越传统分步设计方法
- 适合研究多机器人协同系统设计的科研人员
多机器人系统中有趣的高效群体行为源自个体行为。而个体行为的功能空间又受机器人外形或物理结构的影响。因此,通过联合优化个体机器人的外形与行为,并基于环境对群体表现的反馈,可充分释放多机器人系统的潜力,而非传统上分步或分离处理。本文提出一种高效的协同设计方法,聚焦于洪灾响应场景下的多机器人任务分配(MRTA)问题,利用图强化学习设计个体行为。计算效率得益于一种近似精确的问题分解方式:一是识别并利用表征形态依赖能力的帕累托前沿能力指标,二是学习最佳能力组合与个体策略以共同最大化任务性能。在多架无人飞行器洪灾响应案例中,该方法显著优于分步设计基线。对比发现,单机与多机协同设计的形态和学习行为存在显著差异。
原文摘要 · Abstract (English)
Interesting and efficient collective behavior observed in multi-robot or swarm systems emerges from the individual behavior of the robots. The functional space of individual robot behaviors is in turn shaped or constrained by the robot's morphology or physical design. Thus the full potential of multi-robot systems can be realized by concurrently optimizing the morphology and behavior of individual robots, informed by the environment's feedback about their collective performance, as opposed to treating morphology and behavior choices disparately or in sequence (the classical approach). This paper presents an efficient concurrent design or co-design method to explore this potential and understand how morphology choices impact collective behavior, particularly in an MRTA problem focused on a flood response scenario, where the individual behavior is designed via graph reinforcement learning. Computational efficiency in this case is attributed to a new way of near exact decomposition of the co-design problem into a series of simpler optimization and learning problems. This is achieved through i) the identification and use of the Pareto front of Talent metrics that represent morphology-dependent robot capabilities, and ii) learning the selection of Talent best trade-offs and individual robot policy that jointly maximizes the MRTA performance. Applied to a multi-unmanned aerial vehicle flood response use case, the co-design outcomes are shown to readily outperform sequential design baselines. Significant differences in morphology and learned behavior are also observed when comparing co-designed single robot vs. co-designed multi-robot systems for similar operations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。