arXiv:2503.16803cs.ROcs.LG2025-03

提出BEAC框架,让机器人学会在看不见物体时自主探索与任务操作切换。

BEAC: Imitating Complex Exploration and Task-oriented Behaviors for Invisible Object Nonprehensile Manipulation

  • 设计预设探索规则+信念状态驱动的任务动作策略,实现行为模式切换
  • 模拟与实机实验均达到最高任务成功率,模式与动作预测准确率更高
  • 适合复杂非抓取场景,降低示范者认知负担

在部分观测下进行不可见物体的非抓取操作(如挖掘埋藏岩石)时,模仿学习面临挑战:示范者需在探索寻物与任务执行间动态决策,并估计隐藏状态,易导致动作不一致和高认知负荷。受人类认知科学启发,本文提出贝叶斯探索-动作克隆(BEAC)框架,采用预设探索策略与基于历史信念状态训练的任务动作策略之间的切换结构。通过仿真与真实机器人实验验证,该方法在任务完成率、模式与动作预测准确率上表现最优,且用户研究显示示范过程认知负荷显著降低。

原文摘要 · Abstract (English)

Applying imitation learning (IL) is challenging to nonprehensile manipulation tasks of invisible objects with partial observations, such as excavating buried rocks. The demonstrator must make such complex action decisions as exploring to find the object and task-oriented actions to complete the task while estimating its hidden state, perhaps causing inconsistent action demonstration and high cognitive load problems. For these problems, work in human cognitive science suggests that promoting the use of pre-designed, simple exploration rules for the demonstrator may alleviate the problems of action inconsistency and high cognitive load. Therefore, when performing imitation learning from demonstrations using such exploration rules, it is important to accurately imitate not only the demonstrator's task-oriented behavior but also his/her mode-switching behavior (exploratory or task-oriented behavior) under partial observation. Based on the above considerations, this paper proposes a novel imitation learning framework called Belief Exploration-Action Cloning (BEAC), which has a switching policy structure between a pre-designed exploration policy and a task-oriented action policy trained on the estimated belief states based on past history. In simulation and real robot experiments, we confirmed that our proposed method achieved the best task performance, higher mode and action prediction accuracies, while reducing the cognitive load in the demonstration indicated by a user study.

模仿学习非抓取操作信念估计行为切换

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。