arXiv:2601.21988cs.LGcs.AI2026-01

提出统一框架,用有向信息定义通用信息收集成本。

Generalized Information Gathering Under Dynamics Uncertainty

  • 基于马尔可夫加性噪声假设,构建与模型选择解耦的信息收集成本。
  • 证明现有互信息成本是该框架的特例,理论统一性更强。
  • 适用于线性、非线性及多智能体系统,适合强化学习与主动感知研究者。

在未知动力系统中,智能体需从观测中学习系统动态。主动信息收集可加速学习,但现有方法针对特定建模选择(如动力学模型、信念更新方式、观测模型和规划器)设计专用成本函数。本文提出一个统一框架,通过显式揭示参数、信念与控制间的因果依赖,将这些选择与信息收集成本解耦。在此框架下,我们基于马塞信息推导出一种通用信息收集成本,仅假设系统为马尔可夫且含加性噪声,其余部分对建模选择完全无关。我们证明,现有文献中使用的互信息成本是该成本的特例。进一步,我们建立互信息成本与线性化贝叶斯估计中信息增益之间的明确联系,为基于互信息的主动学习方法提供理论依据。最后,通过线性、非线性及多智能体系统的实验,验证了该框架的实际效用。

原文摘要 · Abstract (English)

An agent operating in an unknown dynamical system must learn its dynamics from observations. Active information gathering accelerates this learning, but existing methods derive bespoke costs for specific modeling choices: dynamics models, belief update procedures, observation models, and planners. We present a unifying framework that decouples these choices from the information-gathering cost by explicitly exposing the causal dependencies between parameters, beliefs, and controls. Using this framework, we derive a general information-gathering cost based on Massey's directed information that assumes only Markov dynamics with additive noise and is otherwise agnostic to modeling choices. We prove that the mutual information cost used in existing literature is a special case of our cost. Then, we leverage our framework to establish an explicit connection between the mutual information cost and information gain in linearized Bayesian estimation, thereby providing theoretical justification for mutual information-based active learning approaches. Finally, we illustrate the practical utility of our framework through experiments spanning linear, nonlinear, and multi-agent systems.

主动学习信息论强化学习动态系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。