arXiv:2609.02890cs.CL2026-09

用自洽迭代优化方法,让压缩后的用户画像在分类任务上媲美传统检索。

Bounded Personas Match Retrieval on Classification but Not Regression for a Frozen Agent

论文配图:Bounded Personas Match Retrieval on Classification but Not Regression for a Frozen Agent
图 1 · 摘自论文原文
  • 通过递归自评和修正,将用户历史压缩成三字段固定长度画像。
  • 在新闻分类任务中,准确率达0.745-0.755,与检索方法无显著差异。
  • 适合对推理效率有要求、需保持可解释性的个性化代理场景。

个性化语言代理需将用户交互历史转化为新请求下的行为。主流策略有两种:检索将用户最相关的过往条目引入提示,准确但成本随历史增长;蒸馏则一次性将历史压缩为紧凑自然语言画像,具有边界固定、查询无关、可解释等优势,但普遍认为会牺牲精度。是否以及在何种任务上蒸馏画像能匹配检索尚未清晰界定。本文提出PersonaLink,一种无需训练的方法,将用户历史蒸馏为固定三字段画像,并递归优化:每轮在用户自有标注历史的保留子集上,由冻结的7B模型自评估,根据错误重写画像,仅当不退化时才保留。因所有对比共享同一冻结7B主干,仅上下文不同,该设计分离了表征与模型的影响。结果揭示明确的任务类型不对称:在200名用户的LaMP-2数据集(15类新闻分类)上,PersonaLink准确率为0.745–0.755,与BM25检索(0.760–0.765)统计无差异。

原文摘要 · Abstract (English)

A personalized language agent must convert a user's interaction history into behavior on each new request at inference time. Two strategies dominate. Retrieval pulls a few of the user's most relevant past items into the prompt, which is accurate but pays a per-query selection and context cost that grows with the history. Distillation instead compresses the history once into a compact natural-language persona, which is bounded, query-independent, and interpretable, but is widely assumed to sacrifice accuracy. Whether, and on which tasks, a distilled persona can match retrieval has not been characterized cleanly. We introduce PersonaLink, a training-free method that distills a user's history into a bounded three-field persona and recursively refines it: each pass self-evaluates the frozen agent on a held-out slice of the user's own labeled history, rewrites the persona from its errors, and keeps the result only when it does not regress on that slice. Because every comparison shares one frozen 7B backbone and differs only in what is placed in context, the design isolates the effect of representation from that of the model. The result is a clear task-type asymmetry. On 200 users of LaMP-2 (15-way news categorization), PersonaLink reaches 0.745-0.755 accuracy, statistically indistinguishable from BM25 retrieval (0.760-0.765).

个性化代理知识蒸馏分类任务画像压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。