用可定制的LLM架构识别文本中的人类价值观,避免固定理论束缚。
Identifying and Understanding Human Values in Text: A Tailorable LLM-based Architecture

- 分模块设计:先生成价值规范,再标注文本,最后评估支持强度。
- 在ValueEval数据集上表现良好,验证了方法通用性。
- 适合研究伦理决策、价值观对齐或跨理论分析的研究者。
随着智能系统自主性增强,学界致力于构建包含伦理与道德考量的决策机制,而非传统效用最大化模型。关键挑战在于评估决策与人类价值观的契合度。近年来,基于大语言模型(LLM)从文本中识别显性或隐性人类价值观成为重要方向。本文提出一种可定制的LLM架构,用于检测并量化文本中人类价值观的强度,克服了以往方法依赖特定价值理论或复杂提示工程的局限。该架构包含三个协同模块:基于理论基础文本生成结构化价值规范;利用这些规范标注文本;根据修辞与语义证据分配支持或反对程度。该模块化设计将价值概念化与检测分离,实现可扩展、可复现的流程,且价值规范可适配多种理论。采用多种LLM实现并基于ValueEval数据集评估,实验表明该方法具备良好检测性能,验证了其通用性。
原文摘要 · Abstract (English)
As intelligent systems become more autonomous, the scientific community focuses on creating decision-making mechanisms that include ethical and moral considerations, unlike traditional utility-maximisation models. To achieve this, a key aspect is assessing how well these decisions align with human values. To this end, a promising line of research is centred on developing approaches based on Large Language Models (LLMs) to identify human values from text, whether explicit or implicit, enabling their recognition throughout. This paper introduces a LLM-based architecture to detect and quantify the intensity of human values in text, avoiding the limitations of previous approaches tied to specific value theory or complex prompt engineering. The architecture comprises three coordinated modules: one that generates structured value specifications from the foundational texts of any theoretical framework; one that labels texts using these specifications; and one that assigns graded support or resistance based on rhetorical and semantic evidence. This modular approach separates the tasks of conceptualising from detecting human values, creating a scalable and reproducible process driven by value specifications adaptable to various theories. The architecture was instantiated with multiple LLMs and evaluated using the ValueEval dataset. The experiments demonstrate good detection performance, confirming the generality of the pipeline.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。