用不确定性引导探索,让软体机器人自动生成通用动力学模型。
Learning Soft Robotic Dynamics with Active Exploration
- 基于概率集成模型估计认知不确定性,主动探索未覆盖状态空间。
- 在3个仿真平台和1个真实软臂上实现更精准的动态建模与零样本控制。
- 适合研究软体机器人自主学习、数据高效控制的学者与工程师。
软体机器人在非结构化环境中展现出卓越的适应性与安全性,但其柔性、高维且非线性的动力学特性使得建模与控制极为困难。现有数据驱动方法常因任务示范范围狭窄或探索效率低而难以泛化。本文提出SoftAE,一种面向不确定性的主动探索框架,可自主学习任务无关且可泛化的软体机器人动力学模型。SoftAE利用概率集成模型估计认知不确定性,并主动引导探索至状态-动作空间中未充分覆盖的区域,实现多样行为的高效覆盖,无需任务特定监督。我们在三个仿真平台(连续臂、流体中的仿生鱼、混合驱动肌骨腿)及一个气动驱动的连续软臂上进行了评估。相比随机探索与任务特定的基于模型强化学习,SoftAE生成的动态模型更准确,支持对未见任务的优异零样本控制,并在传感噪声、执行延迟和非线性材料效应下保持鲁棒性。结果表明,基于不确定性的主动探索可生成跨多种软体机器人形态的可扩展、可复用的动力学模型,推动了柔性机器人自主、适应性强且数据高效的控制发展。
原文摘要 · Abstract (English)
Soft robots offer unmatched adaptability and safety in unstructured environments, yet their compliant, high-dimensional, and nonlinear dynamics make modeling for control notoriously difficult. Existing data-driven approaches often fail to generalize, constrained by narrowly focused task demonstrations or inefficient random exploration. We introduce SoftAE, an uncertainty-aware active exploration framework that autonomously learns task-agnostic and generalizable dynamics models of soft robotic systems. SoftAE employs probabilistic ensemble models to estimate epistemic uncertainty and actively guides exploration toward underrepresented regions of the state-action space, achieving efficient coverage of diverse behaviors without task-specific supervision. We evaluate SoftAE on three simulated soft robotic platforms -- a continuum arm, an articulated fish in fluid, and a musculoskeletal leg with hybrid actuation -- and on a pneumatically actuated continuum soft arm in the real world. Compared with random exploration and task-specific model-based reinforcement learning, SoftAE produces more accurate dynamics models, enables superior zero-shot control on unseen tasks, and maintains robustness under sensing noise, actuation delays, and nonlinear material effects. These results demonstrate that uncertainty-driven active exploration can yield scalable, reusable dynamics models across diverse soft robotic morphologies, representing a step toward more autonomous, adaptable, and data-efficient control in compliant robots.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。