arXiv:2602.17695cs.LGcs.AI2026-02被引 2

用可解释属性实现精准个性化的解码阶段个性化方法

EXACT: Explicit Attribute-Guided Decoding-Time Personalization

  • 基于预定义属性集,通过偏好反馈识别用户专属属性子集
  • 在线推理时检索语义相关属性注入上下文,提升生成契合度
  • 理论证明可缓解上下文偏好漂移,适合需要可解释个性化的场景

实现个性化对齐需将大语言模型适配到每位用户的动态上下文。尽管解码阶段个性化相比训练阶段更具可扩展性,现有方法多依赖隐式且难以解释的偏好表示,并采用僵化、与上下文无关的用户表征,未能捕捉偏好随提示变化的特性。本文提出EXACT,一种基于预定义可解释属性的解码阶段个性化方法,仅需有限的成对偏好反馈即可对齐生成结果。在离线阶段,EXACT通过最大化偏好响应的似然来识别用户特定属性子集;在线推理时,根据输入提示检索最相关的属性并注入上下文以引导生成。我们在弱假设下建立了该算法的理论近似保证,严格证明了基于相似性的检索机制能有效缓解上下文偏好漂移,在不合并冲突偏好前提下适应不同任务。在人工标注偏好数据集上的大量实验表明,EXACT持续优于强基线,涵盖偏好建模准确率与个性化生成质量。

原文摘要 · Abstract (English)

Achieving personalized alignment requires adapting large language models to each user's evolving context. While decoding-time personalization offers a scalable alternative to training-time methods, existing methods largely rely on implicit, less interpretable preference representations and impose a rigid, context-agnostic user representation, failing to account for how preferences shift across prompts. We introduce EXACT, a new decoding-time personalization that aligns generation with limited pairwise preference feedback using a predefined set of interpretable attributes. EXACT first identifies user-specific attribute subsets by maximizing the likelihood of preferred responses in the offline stage. Then, for online inference, EXACT retrieves the most semantically relevant attributes for an incoming prompt and injects them into the context to steer generation. We establish theoretical approximation guarantees for the proposed algorithm under mild assumptions, and provably show that our similarity-based retrieval mechanism effectively mitigates contextual preference shifts, adapting to disparate tasks without pooling conflicting preferences. Extensive experiments on human-annotated preference datasets demonstrate that EXACT consistently outperforms strong baselines, including preference modeling accuracy and personalized generation quality.

个性化解码优化属性建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。