让检索增强生成的向量会记时间、识可信度、懂依赖关系。
Self-Aware Vector Embeddings for Retrieval-Augmented Generation: A Neuroscience-Inspired Framework for Temporal, Confidence-Weighted, and Relational Knowledge
- 向量嵌入加入时间、置信度和关系属性,模拟大脑记忆固化过程。
- 在版本化查询上准确率提升至62.0%,较传统方法翻倍,过时回答减少逾60%。
- 适合需要动态知识更新与高可靠性生成的场景,如技术文档与医疗问答。
当前检索增强生成(RAG)系统将向量嵌入视为静态、无上下文的表示:嵌入不记录创建时间、来源可信度或与其他嵌入的依赖关系。这种知识扁平化导致显著性能损失:已有研究显示,传统RAG在版本化技术查询上的准确率仅为58%。本文提出SmartVector框架,为密集嵌入显式添加三种属性——时间感知、置信度衰减与关系感知,并采用五阶段生命周期模型,类比海马体-皮层记忆巩固机制。检索管道以四信号得分替代纯余弦相似度,融合语义相关性、时间有效性、实时置信度与图关系重要性。后台巩固代理检测矛盾、构建依赖边,并沿边传播更新,类似图神经网络消息传递。置信度由闭式函数控制,结合艾宾浩斯式指数衰减、用户反馈重巩固及对数访问强化。我们形式化该模型,关联其与时间知识图谱嵌入、智能体记忆架构及不确定性感知RAG的关系,并提供可复现的参考实现。在包含258个向量与138个查询的合成版本政策基准测试中,SmartVector相较基础余弦RAG,top-1准确率从31.0%提升至62.0%,过时回答率由35.0%降至13.3%,期望校准误差减少近两倍(0.244 vs. 0.470),单字编辑的重新嵌入成本降低77%,且在0%至75%矛盾注入率下均表现稳健。
原文摘要 · Abstract (English)
Modern retrieval-augmented generation (RAG) systems treat vector embeddings as static, context-free artifacts: an embedding has no notion of when it was created, how trustworthy its source is, or which other embeddings depend on it. This flattening of knowledge has a measurable cost: recent work on VersionRAG reports that conventional RAG achieves only 58% accuracy on versioned technical queries, because retrieval returns semantically similar but temporally invalid content. We propose SmartVector, a framework that augments dense embeddings with three explicit properties -- temporal awareness, confidence decay, and relational awareness -- and a five-stage lifecycle modeled on hippocampal-neocortical memory consolidation. A retrieval pipeline replaces pure cosine similarity with a four-signal score that mixes semantic relevance, temporal validity, live confidence, and graph-relational importance. A background consolidation agent detects contradictions, builds dependency edges, and propagates updates along those edges as graph-neural-network-style messages. Confidence is governed by a closed-form function combining an Ebbinghaus-style exponential decay, user-feedback reconsolidation, and logarithmic access reinforcement. We formalize the model, relate it to temporal knowledge graph embedding, agentic memory architectures, and uncertainty-aware RAG, and present a reference implementation. On a reproducible synthetic versioned-policy benchmark of 258 vectors and 138 queries, SmartVector roughly doubles top-1 accuracy over plain cosine RAG (62.0% vs. 31.0% on a held-out split), drops stale-answer rate from 35.0% to 13.3%, cuts Expected Calibration Error by nearly 2x (0.244 vs. 0.470), reduces re-embedding cost per single-word edit by 77%, and is robust across contradiction-injection rates from 0% to 75%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。