用属性分解方法让AI理解用户偏好的深层原因。
PrefPalette: Personalized Preference Modeling with Latent Attributes
- 将偏好拆解为形式、幽默等属性维度,生成合成数据分离影响。
- 在Reddit 45个社群上预测准确率比GPT-4o高46.6%。
- 可解释社区差异,适合做个性化推荐与价值对齐系统。
个性化AI需理解用户偏好及其背后的原因,但现有模型常将人类判断视为黑箱。本文提出PrefPalette框架,将偏好分解为属性维度,并以可解释方式适配不同社交群体的价值观。该框架基于多属性决策认知原理:(1)通过可扩展的反事实属性合成生成训练数据,分离形式、幽默、文化价值观等单属性影响;(2)采用注意力机制学习不同社群对这些属性的动态权重。在Reddit 45个社群上的评估显示,PrefPalette平均预测准确率比GPT-4o高出46.6%。此外,模型揭示了直观的社群特征:学术类社区重视冗长与刺激性,冲突导向型重视讽刺与直接,支持型则强调共情。通过建模人类判断的属性中介结构,PrefPalette不仅提升预测性能,还提供透明可解释的洞察,是迈向更可信、价值敏感的个性化应用的关键一步。
原文摘要 · Abstract (English)
Personalizing AI systems requires understanding not just what users prefer, but the reasons that underlie those preferences - yet current preference models typically treat human judgment as a black box. We introduce PrefPalette, a framework that decomposes preferences into attribute dimensions and tailors its preference prediction to distinct social community values in a human-interpretable manner. PrefPalette operationalizes a cognitive science principle known as multi-attribute decision making in two ways: (1) a scalable counterfactual attribute synthesis step that involves generating synthetic training data to isolate for individual attribute effects (e.g., formality, humor, cultural values), and (2) attention-based preference modeling that learns how different social communities dynamically weight these attributes. This approach moves beyond aggregate preference modeling to capture the diverse evaluation frameworks that drive human judgment. When evaluated on 45 social communities from the online platform Reddit, PrefPalette outperforms GPT-4o by 46.6% in average prediction accuracy. Beyond raw predictive improvements, PrefPalette also shed light on intuitive, community-specific profiles: scholarly communities prioritize verbosity and stimulation, conflict-oriented communities value sarcasm and directness, and support-based communities emphasize empathy. By modeling the attribute-mediated structure of human judgment, PrefPalette delivers both superior preference modeling and transparent, interpretable insights, and serves as a first step toward more trustworthy, value-aware personalized applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。