arXiv:2606.08104cs.RO2026-06中稿 · Nature Communicati…被引 1

在共享嵌入空间中用强化学习实现软体机器人快速通用控制

Reinforcement learning in linear embedding space unlocks generalizable control across soft robot configurations

论文配图:Reinforcement learning in linear embedding space unlocks generalizable control across soft robot configurations
图 1 · 摘自论文原文
  • 将机器人动力学映射到线性柯尔莫哥洛夫嵌入空间,解耦控制策略与形态
  • 33种配置间迁移样本减少75倍,支持高速、重载和多执行器故障场景
  • 适合需要快速适配新形态的软体机器人研发与实际应用

软体生物如章鱼和象鼻具有出色的形态可塑性,能动态调整身体形状与刚度,并灵活改变控制策略以实现多样化行为。受此类生物系统启发,近年来出现了多种软体机器人,其材料、刚度和形态各异,针对特定任务设计。尽管软体机器人在材料与结构设计上取得显著进展,但开发能快速适应多种构型的通用控制框架仍是长期挑战。现有控制器局限于固定构型,新增构型需耗费大量精力重新建模与策略设计。本文提出一种基于共享线性柯尔莫哥洛夫嵌入空间的强化学习通用控制方法,通过将机器人动力学编码至该嵌入空间,实现控制策略与具体形态解耦,从而无需从头训练即可实现实时、无模型的策略跨构型自适应。我们在33种不同机器人构型上验证了该系统,结果显示配置间迁移样本减少75倍,且在高速运动、重载及多执行器故障下仍保持稳健性能,实现了此前软体机器人难以达到的实际技能。该工作建立了一种统一且可扩展的软体机器人控制范式,弥合了机械重构能力与控制灵活性之间的鸿沟,为复杂物理系统的通用控制提供了更广泛启示。

原文摘要 · Abstract (English)

Soft-bodied organisms such as octopuses and elephant trunks exhibit remarkable morphological adaptability, dynamically reconfiguring body shape and stiffness, and flexibly adjusting their control strategies to enable versatile behaviors. Inspired by these biological systems, various soft robots have emerged in recent decades, featuring diverse materials, stiffnesses, and morphologies tailored to specific tasks. Despite substantial advances in the materials and structural designs of soft robots, developing a generalizable control framework capable of rapid adaptation across diverse configurations remains a long-standing challenge. Existing controllers are limited to fixed configurations, demanding laborious configuration-specific remodelling and policy redesign for new configurations. Here, we introduce a generalizable control system that enables rapid adaptation across diverse soft robot configurations via reinforcement learning in a shared linear Koopman embedding space. By encoding robot dynamics into this embedding space, our method decouples control policies from specific morphologies, allowing real-time, model-free policy adaptation across diverse configurations without retraining from scratch. We validate our system across 33 distinct robot configurations. Our system achieves a 75 times reduction in transfer samples across configurations, while sustaining robust performance under high-speed motion, heavy payloads, and multiactuator faults, and achieving real-world skills previously unattainable in soft robotics. This work establishes a unified and adaptable control paradigm for diverse soft robot configurations, bridging mechanical reconfigurability with control flexibility, and may offer broader insights for generalizable control in complex physical systems.

软体机器人强化学习通用控制嵌入空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。