arXiv:2508.12027cs.AIcs.LG2025-08被引 2

不依赖自身动作信息的智能体也能实现接近知情智能体的导航性能。

Active inference for action-unaware agents

  • 用主动推理框架建模无动作感知的智能体,通过观察推断自身行为
  • 在两种导航任务中,无动作感知智能体表现接近有动作感知版本
  • 适用于缺乏动作反馈信号的机器人或神经科学建模场景

主动推理是一种基于近似贝叶斯推断的认知研究范式,认为适应性智能体通过最小化变分自由能和期望自由能来实现感知与决策。最小化前者解释了感知与学习中的证据积累过程,而最小化后者则描述了智能体如何随时间选择行动。在此框架下,智能体能够最大化对理想观测或状态的似然性,前提是存在环境的生成模型。然而,现有方法对如何规划未来行动存在不同策略:部分方法假设智能体知晓自身动作(具备传出副本信号),从而更优地规划;另一些方法则假设智能体无法直接知悉自身动作,需从近期观测中推断,再进行规划。本工作在两个导航任务中对比了有动作感知与无动作感知智能体的性能,结果表明,即使在严重劣势下,无动作感知智能体仍可达到与有动作感知智能体相当的性能水平。

原文摘要 · Abstract (English)

Active inference is a formal approach to study cognition based on the notion that adaptive agents can be seen as engaging in a process of approximate Bayesian inference, via the minimisation of variational and expected free energies. Minimising the former provides an account of perceptual processes and learning as evidence accumulation, while minimising the latter describes how agents select their actions over time. In this way, adaptive agents are able to maximise the likelihood of preferred observations or states, given a generative model of the environment. In the literature, however, different strategies have been proposed to describe how agents can plan their future actions. While they all share the notion that some kind of expected free energy offers an appropriate way to score policies, sequences of actions, in terms of their desirability, there are different ways to consider the contribution of past motor experience to the agent's future behaviour. In some approaches, agents are assumed to know their own actions, and use such knowledge to better plan for the future. In other approaches, agents are unaware of their actions, and must infer their motor behaviour from recent observations in order to plan for the future. This difference reflects a standard point of departure in two leading frameworks in motor control based on the presence, or not, of an efference copy signal representing knowledge about an agent's own actions. In this work we compare the performances of action-aware and action-unaware agents in two navigations tasks, showing how action-unaware agents can achieve performances comparable to action-aware ones while at a severe disadvantage.

主动推理智能体行为导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。