arXiv:2508.19172cs.ROcs.AI2025-08中稿 · CoRL

无需人工干预,机器人在真实世界自主发现并掌握多样高阶技能。

From Tabula Rasa to Emergent Abilities: Discovering Robot Skills via Real-World Unsupervised Quality-Diversity

  • 基于质量-多样性框架,自动构建技能空间,无需预设规则。
  • 在仿真与真实四足机器人上成功发现多种行走技能,性能优于基线。
  • 技能库可复用于损伤适应等下游任务,适合追求自主性的机器人研究者。

自主技能发现旨在使机器人在无显式监督下习得多样化行为。然而,直接在物理硬件上学习仍面临安全性和数据效率的挑战。现有方法如质量-多样性强化学习(QDAC)依赖人工定义的技能空间和精细调参,限制了其在真实场景中的应用。本文提出无监督真实世界技能获取方法(URSA),扩展了QDAC框架,使机器人能够在真实环境中自主发现并掌握多样且高性能的技能。我们在Unitree A1四足机器人上验证了该方法在仿真与真实世界中均能成功发现多种运动技能。该方法支持启发式驱动与完全无监督两种设置。此外,所学技能库可用于下游任务如真实世界损伤适应,在9种仿真场景中有5种、5种真实场景中有3种表现优于所有基线。结果表明,该方法为低人工干预的持续技能发现提供了新范式,推动更自主、自适应的机器人系统发展。演示视频见 https://adaptive-intelligent-robotics.github.io/URSA。

原文摘要 · Abstract (English)

Autonomous skill discovery aims to enable robots to acquire diverse behaviors without explicit supervision. Learning such behaviors directly on physical hardware remains challenging due to safety and data efficiency constraints. Existing methods, including Quality-Diversity Actor-Critic (QDAC), require manually defined skill spaces and carefully tuned heuristics, limiting real-world applicability. We propose Unsupervised Real-world Skill Acquisition (URSA), an extension of QDAC that enables robots to autonomously discover and master diverse, high-performing skills directly in the real world. We demonstrate that URSA successfully discovers diverse locomotion skills on a Unitree A1 quadruped in both simulation and the real world. Our approach supports both heuristic-driven skill discovery and fully unsupervised settings. We also show that the learned skill repertoire can be reused for downstream tasks such as real-world damage adaptation, where URSA outperforms all baselines in 5 out of 9 simulated and 3 out of 5 real-world damage scenarios. Our results establish a new framework for real-world robot learning that enables continuous skill discovery with limited human intervention, representing a significant step toward more autonomous and adaptable robotic systems. Demonstration videos are available at https://adaptive-intelligent-robotics.github.io/URSA.

机器人学习技能发现无监督真实世界

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。