不同知识应有不同过期速度,新模型自动学习动态衰减规律。
Not All Memories Age the Same: Autodiscovery of Adaptive Decay in Knowledge Graphs
- 用速度与波动性构建连续衰减表面,替代统一过期机制。
- 在真实数据中验证了知识寿命符合林迪效应,且分层参数可有效提升检索性能。
- 无需领域知识,全由数据驱动,适合医疗、百科等动态知识系统。
用于检索的知识图谱通常将所有事实视为同等时效,现有时间方法采用统一衰减曲线,忽略知识类型差异。本文指出这种设定根本错误:不同知识类型具有不同的时间动态,核心问题并非延迟或吞吐,而是查询时识别重要信息。我们提出分层框架,以速度(概念出现频率)和波动性(观测间值变化程度,通过嵌入距离衡量)为正交信号,构建连续衰减表面。该表面分解为三个可学习层级:领域级参数捕捉普遍模式(某些谓词天然永久,某些则天然短暂),上下文级参数捕获环境依赖变化,实体级适应个性化特定主体的衰减。所有参数通过生存分析从观测值寿命中自动推导,无需预定义分类或领域专家。我们将边寿命建模为生存问题,事件为值被有意义的新值取代(而非仅重访)。在合成时序知识图上,成功恢复了预设分层参数(HDBSCAN ARI = 1.0)。在107篇维基文章和1,163例来自Synthea临床电子病历模拟器的患者记录上验证,速度-波动性聚类自然涌现,与可观测持久性模式一致,且普遍呈现林迪效应(Weibull形状参数k < 1)。统一衰减性能比无时间加权差18倍,异构衰减显著改善,各层级均带来可测量提升。
原文摘要 · Abstract (English)
Knowledge graphs used for retrieval treat all facts as equally current. Existing temporal approaches apply uniform decay, using a single forgetting curve regardless of knowledge type. We show this is fundamentally misspecified: different knowledge types exhibit different temporal dynamics, and the core retrieval problem is not latency or throughput but identifying what is important at query time. We propose a hierarchical framework that replaces uniform decay with a continuous decay surface parameterized by two orthogonal signals: velocity (how frequently a concept is observed) and volatility (how much the value changes between observations, measured via embedding distance). The decay surface is decomposed into three learnable levels: domain-level parameters capture universal patterns (some predicates are inherently permanent, others inherently transient), context-level parameters capture setting-dependent variation, and entity-level adaptation personalizes decay to specific subjects. All parameters emerge from data through survival analysis on observed value lifetimes, requiring no predefined taxonomies or domain expertise. We formulate edge lifetime as a survival problem where the event is value supersession (a meaningfully different value replacing the current one), distinct from mere re-observation. Experiments on synthetic temporal knowledge graphs demonstrate recovery of planted hierarchical parameters (HDBSCAN ARI = 1.0). Validation on 107 Wikipedia articles and 1,163 patient records from the Synthea clinical EHR simulator shows that velocity-volatility clusters emerge naturally, align with observable persistence patterns, and near-universally exhibit the Lindy effect (Weibull shape k < 1). Uniform decay performs 18x worse than no temporal weighting. Heterogeneous decay recovers from this, with each hierarchy level contributing measurable improvement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。