arXiv:2604.03479cs.AIcs.IT2026-04被引 2

用共享隐状态干预实现上下文控制,不增加记忆规模。

Contextual Control without Memory Growth in a Context-Switching Task

  • 通过上下文索引的加性操作干预共享隐状态
  • 无需额外维度,在基准任务上表现接近带记忆模型
  • 适合关注内存效率的序列决策场景

上下文依赖的序列决策通常通过显式输入上下文或扩大循环记忆来实现。本文提出第三种方法:在不增加循环维度的前提下,通过对共享循环隐状态进行干预来实现上下文依赖。我们设计了一种基于干预的循环架构,其中循环核心先生成共享的预干预隐状态,随后上下文通过一个加性、上下文索引的操作器作用于该状态。我们在部分可观测的上下文切换序列决策任务上评估该方法,并与三种模型对比:直接访问上下文的标签辅助基线、扩大循环状态的内存基线,以及本文提出的干预模型(既无直接上下文输入,也无记忆增长)。在主要基准测试中,干预模型在不增加循环维度的情况下表现强劲。我们还使用条件互信息 I(C;O | S) 作为理论驱动的探测指标,衡量固定隐状态下的上下文依赖程度。对于任务相关的阶段1结果,干预模型显示出正的条件上下文信息。结果表明,对共享隐状态的干预是该设定下替代循环记忆增长的一种可行方案。

原文摘要 · Abstract (English)

Context-dependent sequential decision making is commonly addressed either by providing context explicitly as an input or by increasing recurrent memory so that contextual information can be represented internally. We study a third alternative: realizing contextual dependence by intervening on a shared recurrent latent state, without enlarging recurrent dimensionality. To this end, we introduce an intervention-based recurrent architecture in which a recurrent core first constructs a shared pre-intervention latent state, and context then acts through an additive, context-indexed operator. We evaluate this idea on a context-switching sequential decision task under partial observability. We compare three model families: a label-assisted baseline with direct context access, a memory baseline with enlarged recurrent state, and the proposed intervention model, which uses no direct context input to the recurrent core and no memory growth. On the main benchmark, the intervention model performs strongly without additional recurrent dimensions. We also evaluate the models using the conditional mutual information (I(C;O | S)) as a theorem-motivated operational probe of contextual dependence at fixed latent state. For task-relevant phase-1 outcomes, the intervention model exhibits positive conditional contextual information. Together, these results suggest that intervention on a shared recurrent state provides a viable alternative to recurrent memory growth for contextual control in this setting.

序列决策循环网络上下文控制内存效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。