提出新记忆更新机制,让智能体在持续学习中自动过滤过时信息。
SRMU: Relevance-Gated Updates for Streaming Hyperdimensional Memories

- 用时间衰减+相关性门控,动态决定是否存入新信息
- 内存相似度提升12.6%,总内存大小减少53.5%
- 适合长期运行的实时感知与状态追踪系统
序列关联记忆(SAM)在真实流式环境中难以构建和维护,因观测数据随时间增量到达,采样不平衡且时序动态非平稳。向量符号架构(VSAs)为构建SAM提供了生物启发的框架,将实体与属性编码为准正交高维向量,并通过定义明确的代数运算进行处理。尽管该框架丰富,多数VSA系统仍依赖简单的加法更新,重复观测会强化已有信息,即使无新内容。在非平稳环境中,这导致系统变化后旧信息仍持续存在。本文提出序列相关性记忆单元(SRMU),一种面向VSA-SAM的领域无关、清理无关的更新规则。SRMU结合时间衰减与相关性门控机制,不依赖外部清理,而是通过过滤冗余、冲突和过时信息来调控记忆形成。我们在隔离非均匀采样与非平稳时序动态的流式状态追踪任务上评估了SRMU。结果表明,其使内存相似度提升12.6%,累计内存幅度降低53.5%,证明了其能实现更稳定的记忆增长并更强地对齐真实状态。
原文摘要 · Abstract (English)
Sequential associative memories (SAMs) are difficult to build and maintain in real-world streaming environments, where observations arrive incrementally over time, have imbalanced sampling, and non-stationary temporal dynamics. Vector Symbolic Architectures (VSAs) provide a biologically-inspired framework for building SAMs. Entities and attributes are encoded as quasi-orthogonal hyperdimensional vectors and processed with well defined algebraic operations. Despite this rich framework, most VSA systems rely on simple additive updates, where repeated observations reinforce existing information even when no new information is introduced. In non-stationary environments, this leads to the persistence of stale information after the underlying system changes. In this work, we introduce the Sequential Relevance Memory Unit (SRMU), a domain- and cleanup-agnostic update rule for VSA-based SAMs. The SRMU combines temporal decay with a relevance gating mechanism. Unlike prior approaches that solely rely on cleanup, the SRMU regulates memory formation by filtering redundant, conflicting, and stale information before storage. We evaluate the SRMU on streaming state-tracking tasks that isolate non-uniform sampling and non-stationary temporal dynamics. Our results show that the SRMU increases memory similarity by $12.6\%$ and reduces cumulative memory magnitude by $53.5\%$. This shows that the SRMU produces more stable memory growth and stronger alignment with the ground-truth state.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。