让折纸机器人自动调整结构和控制策略,完成原本做不到的任务。
Co-optimizing Physical Reconfiguration Parameters and Controllers for an Origami-inspired Reconfigurable Manipulator
- 将结构参数与控制器一起用强化学习优化。
- 可实现固定结构无法完成的目标任务,且避免碰撞。
- 适合需要自适应形变的智能机器人研究者参考。
可重构机器人在制造后能改变自身物理构型,具备适应不同环境或任务的潜力。然而,如何为特定任务最优调整可重构参数仍具挑战性,尤其当控制器依赖于机器人构型时。本文以由多个串联折纸模块组成的肌腱驱动可重构机械臂为例,提出一种联合优化方法。在肌腱驱动下,这些模块可通过关节刚度(重构参数)和肌腱位移(控制输入)实现不同形状与运动。我们基于最小势能法建立正向模型,用于预测机械臂在肌腱驱动下的形态;并以此作为环境动力学,利用强化学习联合优化控制策略(肌腱位移)与模块关节刚度,以完成目标到达任务并确保避障。通过联合优化,获得最优关节刚度及对应控制策略,使机械臂完成固定刚度下无法实现的任务。该框架可推广至其他可重构机器人系统,使其针对多样任务与环境自主优化构型与行为。
原文摘要 · Abstract (English)
Reconfigurable robots that can change their physical configuration post-fabrication have demonstrate their potential in adapting to different environments or tasks. However, it is challenging to determine how to optimally adjust reconfigurable parameters for a given task, especially when the controller depends on the robot's configuration. In this paper, we address this problem using a tendon-driven reconfigurable manipulator composed of multiple serially connected origami-inspired modules as an example. Under tendon actuation, these modules can achieve different shapes and motions, governed by joint stiffnesses (reconfiguration parameters) and the tendon displacements (control inputs). We leverage recent advances in co-optimization of design and control for robotic system to treat reconfiguration parameters as design variables and optimize them using reinforcement learning techniques. We first establish a forward model based on the minimum potential energy method to predict the shape of the manipulator under tendon actuations. Using the forward model as the environment dynamics, we then co-optimize the control policy (on the tendon displacements) and joint stiffnesses of the modules for goal reaching tasks while ensuring collision avoidance. Through co-optimization, we obtain optimized joint stiffness and the corresponding optimal control policy to enable the manipulator to accomplish the task that would be infeasible with fixed reconfiguration parameters (i.e., fixed joint stiffness). We envision the co-optimization framework can be extended to other reconfigurable robotic systems, enabling them to optimally adapt their configuration and behavior for diverse tasks and environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。