arXiv:2510.10221cs.ROcs.AI2025-10被引 1

提出双向注意力模型,让机器人逐步学会像人一样有目标地观察。

A3RNN: Bi-directional Fusion of Bottom-up and Top-down Process for Developmental Visual Attention in Robots

  • 用双向结构融合预测性高层与视觉显著性低层注意力
  • 训练中注意力从关注醒目区域转为依赖预测判断
  • 适合研究机器人认知发展或注意力机制的学者

本研究探讨机器人学习中自上而下(TD)与自下而上(BU)视觉注意力之间的发育性互动。目标是理解结构化的人类式注意力行为如何通过TD与BU机制随时间相互适应而产生。为此,我们提出新型注意力模型A³RNN,通过双向注意力架构整合预测性TD信号与基于显著性的BU线索。在模仿学习的机器人操作任务中评估该模型,实验表明注意力行为在训练过程中发生演变:初期由BU注意力主导,突出视觉显著区域以引导TD过程;随着学习推进,TD注意力趋于稳定,并开始重塑显著性感知。这一演化轨迹符合认知科学与自由能原理,说明感知与内部预测的交互对自我组织注意力至关重要。尽管未显式优化稳定性,本模型仍表现出比基线更连贯、可解释的注意力模式,支持发育机制有助于形成稳健注意力的观点。

原文摘要 · Abstract (English)

This study investigates the developmental interaction between top-down (TD) and bottom-up (BU) visual attention in robotic learning. Our goal is to understand how structured, human-like attentional behavior emerges through the mutual adaptation of TD and BU mechanisms over time. To this end, we propose a novel attention model $A^3 RNN$ that integrates predictive TD signals and saliency-based BU cues through a bi-directional attention architecture. We evaluate our model in robotic manipulation tasks using imitation learning. Experimental results show that attention behaviors evolve throughout training, from saliency-driven exploration to prediction-driven direction. Initially, BU attention highlights visually salient regions, which guide TD processes, while as learning progresses, TD attention stabilizes and begins to reshape what is perceived as salient. This trajectory reflects principles from cognitive science and the free-energy framework, suggesting the importance of self-organizing attention through interaction between perception and internal prediction. Although not explicitly optimized for stability, our model exhibits more coherent and interpretable attention patterns than baselines, supporting the idea that developmental mechanisms contribute to robust attention formation.

注意力机制机器人学习认知发育

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。