arXiv:2507.09037cs.CLcs.AI2025-07被引 2

让大模型决策更符合个人价值观,通过提示词对齐细粒度属性。

ALIGN: Prompt-based Attribute Alignment for Reliable, Responsible, and Personalized LLM-based Decision-Making

  • 用提示词动态对齐大模型与用户细粒度价值属性。
  • 在民意调查和医疗分诊中验证了对齐效果提升决策可靠性。
  • 支持多种分析模式,适合研究个性化大模型决策的学者。

大语言模型(LLMs)正被广泛用于辅助决策,但用户的价值观与偏好差异会影响决策过程,亟需新的对齐与个性化方法。现有工具多聚焦于知识问答等基准任务,而本文提出的ALIGN系统则通过提示词驱动的方式,实现对大模型决策者在细粒度属性上的动态个性化对齐。系统具备稳健的配置管理、带推理过程的结构化输出生成能力,并支持可更换的大模型后端,适配不同分析需求。用户界面支持直观的并列比较,评估多个大模型及其对属性的对齐程度。我们还在两个领域开展定量分析:公众意见调查中的群体人口属性对齐,以及医疗分诊中的价值对齐。整个框架开源,将推动可靠、负责任、个性化的基于大模型的决策研究。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly being used as decision aids. However, users have diverse values and preferences that can affect their decision-making, which requires novel methods for LLM alignment and personalization. Existing LLM comparison tools largely focus on benchmarking tasks, such as knowledge-based question answering. In contrast, our proposed ALIGN system focuses on dynamic personalization of LLM-based decision-makers through prompt-based alignment to a set of fine-grained attributes. Key features of our system include robust configuration management, structured output generation with reasoning, and several algorithm implementations with swappable LLM backbones, enabling different types of analyses. Our user interface enables a qualitative, side-by-side comparison of LLMs and their alignment to various attributes, with a modular backend for easy algorithm integration. Additionally, we perform a quantitative analysis comparing alignment approaches in two different domains: demographic alignment for public opinion surveys and value alignment for medical triage decision-making. The entire ALIGN framework is open source and will enable new research on reliable, responsible, and personalized LLM-based decision-makers.

大模型对齐个性化决策提示工程可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。