arXiv:2605.28969cs.CLcs.AI2026-05

用行为规范层提升AI对用户理解的准确性,让AI决策更贴近真实用户意图。

Beyond Recall: Behavioral Specification as an Interpretive Layer for AI Personalization

论文配图:Beyond Recall: Behavioral Specification as an Interpretive Layer for AI Personalization
图 1 · 摘自论文原文
  • 构建行为规范作为解释层,压缩用户数据为可读模式供语言模型使用。
  • 在14个自传语料上,仅需1/25上下文成本就接近原始数据效果,减少模型犹豫。
  • 适合需要精准用户理解的场景,尤其对预训练中代表性不足的人群帮助最大。

若AI代理代人做决策,其决策必须与用户一致。我们引入‘表征准确度’来衡量系统捕捉用户理解的忠实程度。将解释层具体化为行为规范(Behavioral Specification)。参考实现将用户数据激进压缩为解释性模式,作为语言模型的上下文。我们在一个由5名校准过的大模型评委评分的留出行为预测基准上评估该规范。测试独立及与多种上下文条件组合:完整原始语料、完整提取事实、以及四种商业记忆系统(Mem0, Letta, Supermemory, Zep)。在14个公开自传语料上,该规范总体提升表征准确度,几乎消除模型犹豫;以约25倍的上下文成本节省恢复了原始语料的大部分信息。无论预训练基线如何,该规范使用户表现趋近统一预测水平,绝对提升最大处恰为基线最低点,表明相关人群为预训练中代表性不足者。在需要解释的问题上,该层显著优于提取事实或原始语料;而在依赖回忆的问题上,反而可能产生干扰。结论:表征准确度不同于召回,人类-AI对齐取决于用户表征的精确性,而表征准确度使对齐可测。

原文摘要 · Abstract (English)

If an AI agent makes decisions on a person's behalf, those decisions must align with its user. We introduce representational accuracy to measure how faithfully a system captures a person's interpretation. An interpretive layer is operationalized as a Behavioral Specification. Our reference implementation aggressively compresses a person's data into interpretive patterns, served as context to a language model. We evaluate the Specification on a prototype benchmark of held-out behavioral predictions scored by a calibrated 5-judge LLM panel. We test it independently and in composition with a range of context conditions: full raw corpus, full extracted facts, and four commercial memory systems (Mem0, Letta, Supermemory, Zep). Across 14 public-domain autobiographical corpora, the Specification lifts representational accuracy in aggregate and nearly eliminates model hedging. It recovers most of what the raw corpus delivers, at ~25x less context cost. The Specification lifts subjects toward a common predictive level regardless of pretraining baseline; the lift in absolute points is therefore largest where the baseline is lowest, suggesting the population of relevance is anyone not adequately represented in pretraining. Lift is greatest on interpretation-required questions, where providing an interpretive layer enables model behavior that extracted facts or raw corpus do not. Conversely, on recall-required questions, this layer can interfere rather than help. We conclude that representational accuracy is distinct from recall and that human-AI alignment is dependent on how accurately the user is represented. Representational accuracy makes that alignment testable.

AI对齐个性化行为建模上下文压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。