新基准评估AI对人类全面幸福的促进作用,而非仅防伤害。
Measuring AI Alignment with Human Flourishing
- 从七大维度构建综合评估框架,衡量AI对人类福祉的影响。
- 28个主流大模型平均得分72/100,无一在所有维度达标。
- 适合关注AI伦理、长期社会影响的研究者与开发者。
本文提出人类全面幸福人工智能基准(Flourishing AI Benchmark, FAI Benchmark),从人格与美德、亲密关系、幸福与生活满意度、意义与目的、心理健康与身体状况、财务与物质稳定、信仰与灵性七个维度,评估大语言模型对人类整体福祉的促进作用。不同于传统侧重技术能力或危害规避的评测,该基准通过1,229道主客观问题,结合专用评判大模型与跨维度评估,采用几何平均分确保各维度表现均衡。对28个领先语言模型的初步测试显示,尽管最高得分模型达72/100,但无一在所有维度表现可接受,尤其在信仰与灵性、人格与美德、意义与目的方面存在显著差距。该研究为构建真正促进人类繁荣而非仅避免伤害的AI系统提供了新范式,对AI发展、伦理及评估具有深远意义。
原文摘要 · Abstract (English)
This paper introduces the Flourishing AI Benchmark (FAI Benchmark), a novel evaluation framework that assesses AI alignment with human flourishing across seven dimensions: Character and Virtue, Close Social Relationships, Happiness and Life Satisfaction, Meaning and Purpose, Mental and Physical Health, Financial and Material Stability, and Faith and Spirituality. Unlike traditional benchmarks that focus on technical capabilities or harm prevention, the FAI Benchmark measures AI performance on how effectively models contribute to the flourishing of a person across these dimensions. The benchmark evaluates how effectively LLM AI systems align with current research models of holistic human well-being through a comprehensive methodology that incorporates 1,229 objective and subjective questions. Using specialized judge Large Language Models (LLMs) and cross-dimensional evaluation, the FAI Benchmark employs geometric mean scoring to ensure balanced performance across all flourishing dimensions. Initial testing of 28 leading language models reveals that while some models approach holistic alignment (with the highest-scoring models achieving 72/100), none are acceptably aligned across all dimensions, particularly in Faith and Spirituality, Character and Virtue, and Meaning and Purpose. This research establishes a framework for developing AI systems that actively support human flourishing rather than merely avoiding harm, offering significant implications for AI development, ethics, and evaluation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。