让AI根据个人价值观做决策,更懂你、更可靠。
ValuePilot: A Two-Phase Framework for Value-Driven Decision-Making
- 分两阶段构建:先生成带价值标注的场景,再学习个体价值偏好。
- 在新场景中表现优于GPT-5等主流大模型,决策更贴近人类选择。
- 适合需要个性化、可解释性AI的医疗、教育等高敏感领域。
个性化决策对人机交互至关重要,使AI能依据个体价值偏好行动。随着AI进入真实应用,超越任务完成或集体对齐的个性化价值适应成为关键挑战。本文提出一种以价值为导向的个性化决策方法。人类价值观作为稳定、可迁移的信号,支持跨情境的一致与泛化行为。相比依赖外部奖励的任务导向范式,价值驱动决策提升了可解释性,并使代理在新场景中仍能做出恰当响应。我们提出ValuePilot,一个包含数据集生成工具(DGT)和决策模块(DMM)的两阶段框架。DGT通过人-大模型协作流程构建多样化、带价值标注的场景;DMM学习基于个人价值偏好评估行为,实现上下文敏感的个性化决策。在未见过的场景中,DMM的表现优于GPT-5、Claude-Sonnet-4、Gemini-2-flash和Llama-3.1-70b等强基线模型,更符合人类行为选择。结果表明,价值驱动决策是构建可解释、个性化AI代理的有效且可扩展的技术路径。
原文摘要 · Abstract (English)
Personalized decision-making is essential for human-AI interaction, enabling AI agents to act in alignment with individual users' value preferences. As AI systems expand into real-world applications, adapting to personalized values beyond task completion or collective alignment has become a critical challenge. We address this by proposing a value-driven approach to personalized decision-making. Human values serve as stable, transferable signals that support consistent and generalizable behavior across contexts. Compared to task-oriented paradigms driven by external rewards and incentives, value-driven decision-making enhances interpretability and enables agents to act appropriately even in novel scenarios. We introduce ValuePilot, a two-phase framework consisting of a dataset generation toolkit (DGT) and a decision-making module (DMM). DGT constructs diverse, value-annotated scenarios from a human-LLM collaborative pipeline. DMM learns to evaluate actions based on personal value preferences, enabling context-sensitive, individualized decisions. When evaluated on previously unseen scenarios, DMM outperforms strong LLM baselines, including GPT-5, Claude-Sonnet-4, Gemini-2-flash, and Llama-3.1-70b, in aligning with human action choices. Our results demonstrate that value-driven decision-making is an effective and extensible engineering pathway toward building interpretable, personalized AI agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。