arXiv:2605.26612cs.CL2026-05被引 1

用同伴对比预测用户偏好变化,让大模型生成更个性化内容

LATTE: Forecasting Peer Anchored Preference Trajectories for Personalized LLM Generation

论文配图:LATTE: Forecasting Peer Anchored Preference Trajectories for Personalized LLM Generation
图 1 · 摘自论文原文
  • 通过对比相似用户行为,提取用户相对于群体的偏好差值
  • 预测用户偏好轨迹并用单个锚点软令牌注入模型,提升生成质量
  • 适合需要实时个性化生成的场景,如推荐系统、对话机器人

使用冻结的大语言模型进行个性化生成时,需高效且当前的条件信号。现有方法通常以文本检索或摘要方式处理用户历史,或将历史压缩为静态潜在表示或软提示,但这些方法将用户的稳定身份、近期变化和内容信息混合在同一表征中。本文提出LATTE框架,将个性化建模为对同伴锚定的相对偏好状态的预测。对于每个历史会话,LATTE从目标用户与相似用户(对同一项目有响应)的共同基线中减去时间掩码后的基准,得到衡量用户在共享项目上下文中相对于同侪差异的状态。一个轻量级序列预测器随后预测该轨迹的下一个状态,再通过‘状态到标记桥’将预测结果以单一锚定软标记注入冻结的指令微调大模型。潜因子分析表明,同伴锚定可消除共享项目干扰,而时间预测则在过时平均与噪声近期状态之间权衡。在Amazon Reviews 2023和MemoryCD数据集上的实验显示,LATTE始终优于检索、摘要记忆、静态潜在表示、差分感知潜在表示及软提示压缩等基线。在Amazon Reviews 2023上,其平均ROUGE-L从静态潜在表示的0.219、最强附加潜在压缩基线的0.245提升至0.259。额外配对比较与诊断分析表明,性能提升主要源于对用户特定轨迹信息的预测,而非仅增加软提示接口。

原文摘要 · Abstract (English)

Personalized generation with frozen large language models requires a conditioning signal that is both compact and current. Existing personalization methods typically retrieve or summarize user histories in text, or compress them into static latent profiles and soft prompts. These approaches are efficient, but they treat a user's past behavior as an aggregate profile and therefore mix stable identity, recent drift, and item content in the same representation. We propose LAtent Trajectory Tracking and Extrapolation (LATTE), a framework that represents personalization as forecasting a peer anchored relative preference state. For each historical session, LATTE subtracts a time masked baseline formed from comparable users who responded to the same item, producing a state that measures how the target user differs from peers under a shared item context. A lightweight sequence predictor then forecasts the next state in this trajectory, and a State to Token Bridge injects the forecast into a frozen instruction tuned LLM through a single anchored soft token. We provide a latent factor analysis showing when peer anchoring cancels shared item variation and why temporal forecasting trades off stale averages against noisy recent states. Experiments on Amazon Reviews 2023 and MemoryCD show that LATTE consistently outperforms retrieval, summary memory, static latent profiles, difference aware latent profiles, and soft prompt compression baselines. On Amazon Reviews 2023, LATTE improves average ROUGE-L from 0.219 for a static latent profile and 0.245 for the strongest added latent compression baseline to 0.259. Additional pairwise comparisons and diagnostic analyses suggest that the improvement is mainly due to forecasting user-specific trajectory information, rather than merely adding a soft prompt interface.

个性化生成偏好预测软提示大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。