arXiv:2409.08892cs.AIq-bio.NC2024-09被引 1

用率失真理论构建以行为为中心的感知表征,证明无需完整重建数据也能实现最优行为。

Exploring Action-Centric Representations Through the Lens of Rate-Distortion Theory

  • 基于率失真理论设计可压缩的行动导向表征
  • 表征能捕捉任务相关的不变性,且不依赖数据重建
  • 适合研究感知与行为关系的神经科学与强化学习方向

生物体需在高维环境中高效追踪对适应性行为相关的信息。对于资源受限的智能体而言,经济高效的传信至关重要。高效编码假说认为,生物体旨在以高效方式最大化关于感官输入的信息量。在贝叶斯推断下,这意味着大脑需合理分配资源以预测导致感官数据的隐藏状态。然而,这些框架未考虑信息如何被下游利用,忽略了感知系统的行动导向作用。率失真理论(rate-distortion theory)作为在约束条件下定义最优有损压缩的形式化框架,近年来被用于探索目标导向的高效编码。本文在率失真理论背景下探索以行为为中心的表征,并给出抽象概念的数学定义,主张抽象可作为行动中心表征的内容锚点。通过变分自编码器(VAEs)建模,发现此类表征:(i) 是数据的高效有损压缩;(ii) 捕捉达成成功行为所需的任务依赖不变性;(iii) 并非服务于数据重建。因此,我们得出结论:实现最优行为通常无需完全重建数据,这与感知的意向性观点一致。

原文摘要 · Abstract (English)

Organisms have to keep track of the information in the environment that is relevant for adaptive behaviour. Transmitting information in an economical and efficient way becomes crucial for limited-resourced agents living in high-dimensional environments. The efficient coding hypothesis claims that organisms seek to maximize the information about the sensory input in an efficient manner. Under Bayesian inference, this means that the role of the brain is to efficiently allocate resources in order to make predictions about the hidden states that cause sensory data. However, neither of those frameworks accounts for how that information is exploited downstream, leaving aside the action-oriented role of the perceptual system. Rate-distortion theory, which defines optimal lossy compression under constraints, has gained attention as a formal framework to explore goal-oriented efficient coding. In this work, we explore action-centric representations in the context of rate-distortion theory. We also provide a mathematical definition of abstractions and we argue that, as a summary of the relevant details, they can be used to fix the content of action-centric representations. We model action-centric representations using VAEs and we find that such representations i) are efficient lossy compressions of the data; ii) capture the task-dependent invariances necessary to achieve successful behaviour; and iii) are not in service of reconstructing the data. Thus, we conclude that full reconstruction of the data is rarely needed to achieve optimal behaviour, consistent with a teleological approach to perception.

感知表征率失真理论行为导向变分自编码器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。