机器人自主发现动作符号,提升规划效率。
Predictability-Based Curiosity-Guided Action Symbol Discovery
- 基于预测效果的自适应好奇心探索,选最具信息量的动作。
- 在单/双物体操作任务中,成功发现多样且有效的动作符号。
- 适合想实现自主学习与规划的机器人研究者。
为实现机器人抽象推理与高效规划,符号化技能表示至关重要。以往神经符号方法多依赖预设动作库,仅生成感知符号。而真正的发育式机器人系统应能自主发现所有规划所需的抽象。本文提出新系统,可同时自动发现感知符号与动作符号。系统采用编码器-解码器结构,输入物体与动作信息,预测结果效果。为高效探索连续动作空间,引入基于好奇心的探索模块,选择使预测效果分布熵最大的动作。所发现的动作符号用于符号树搜索策略,在单、双物体操作任务中生成有效计划。与两种不同探索策略的基线对比显示,本方法能学习多样化且有效的动作符号,显著提升规划能力。
原文摘要 · Abstract (English)
Discovering symbolic representations for skills is essential for abstract reasoning and efficient planning in robotics. Previous neuro-symbolic robotic studies mostly focused on discovering perceptual symbolic categories given a pre-defined action repertoire and generating plans with given action symbols. A truly developmental robotic system, on the other hand, should be able to discover all the abstractions required for the planning system with minimal human intervention. In this study, we propose a novel system that is designed to discover symbolic action primitives along with perceptual symbols autonomously. Our system is based on an encoder-decoder structure that takes object and action information as input and predicts the generated effect. To efficiently explore the vast continuous action parameter space, we introduce a Curiosity-Based exploration module that selects the most informative actions -- the ones that maximize the entropy in the predicted effect distribution. The discovered symbolic action primitives are then used to make plans using a symbolic tree search strategy in single- and double-object manipulation tasks. We compare our model with two baselines that use different exploration strategies in different experiments. The results show that our approach can learn a diverse set of symbolic action primitives, which are effective for generating plans in order to achieve given manipulation goals.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。