用最少必要记录实现精准个性化,降低上下文开销。
Less Is Personal: Learning Minimal Sufficient User Profiles for Personalized Language Models

- 自适应构建用户画像,按需添加记录或提前停止
- 在6个任务中以更少上下文达更好效果,减少冗余信息
- 适合追求高效个性化的应用,如聊天机器人、推荐系统
检索增强的个性化使大语言模型能利用用户历史记录生成更准确、符合偏好的输出。现有方法通常固定添加若干条检索到的记录,即使后续内容冗余、有害或无关。本文研究最小充分个性化:在保留候选池中可实现效用的前提下,为每个输入构造代价最低的有序用户画像。提出 ENOUGH 方法,通过迭代添加行为记录或发出停止指令,动态生成长度自适应的画像。离线阶段,基于有界反事实搜索评估画像前缀,综合考虑下游收益、用户特异性与令牌成本。将长程目标蒸馏为多头值控制器,显式监督排序与停止决策。推理时,控制器轻量级选择并排序记录,冻结生成器仅在停止后调用一次。六项个性化任务的实验表明,ENOUGHS持续优于强基线,在有效性和效率上均表现更优,实现最小充分画像,保留个性化能力的同时降低无谓上下文开销。
原文摘要 · Abstract (English)
Retrieval-augmented personalization enables large language models to produce more accurate and preference-aligned outputs using relevant records retrieved from user histories. Personalized language models typically prepend a fixed number of retrieved user records, even when additional history is redundant, harmful, or unrelated to a user's distinctive behavior. We study minimal sufficient personalization: constructing the least costly ordered profile for each input while preserving the utility achievable from a retrieved candidate pool. We introduce ENOUGH, a method that iteratively appends behavioral records or emits STOP to construct profiles with adaptive lengths. Offline, bounded counterfactual search evaluates profile prefixes by jointly considering downstream gains, user specificity, and token costs. The resulting long-horizon targets are distilled into a multi-head value controller with explicit ranking and stopping supervision. At inference, the controller selects and orders records through lightweight decisions, and the frozen generator is invoked once after stopping. Extensive experiments on six personalized tasks demonstrate that ENOUGH consistently outperforms strong heuristic and retrieval-augmented baselines in both effectiveness and efficiency, achieving minimal sufficient profiles that preserve personalization utility while reducing unnecessary context costs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。