arXiv:2509.09723cs.CLcs.AI2025-09

用大模型构建心理测量的理论关系网络,突破70年验证瓶颈

ALIGNS: Unlocking nomological networks in psychological measurement through a large language model

  • 基于大模型分析问卷指标,自动生成概念关联图谱
  • 覆盖55万+指标,发现焦虑抑郁量表实为情绪困扰单一维度
  • 可辅助专家发现新维度,适合心理学与政策评估研究者

心理测量对多学科至关重要。尽管测量技术不断进步,但构建命名网络——即概念与测量工具间关系的理论地图以确立效度——仍是挑战,这一问题自克伦巴赫与米尔提出已逾70年。该局限导致临床试验可能无法检测治疗效果,公共政策可能聚焦错误目标。我们提出基于大语言模型的分析系统:分析潜在指标以生成命名结构(ALIGNS),其使用经验证的问卷测量数据进行训练。ALIGNS提供涵盖心理学、医学、社会政策等领域的三套综合性命名网络,包含超过55万项指标。这是大语言模型首次应用于解决测量效度这一基础性难题。我们报告了模型开发所用的分类准确率测试及三项评估:第一项显示广泛使用的NIH PROMIS焦虑与抑郁量表收敛于单一情绪困扰维度;第二项分析儿童气质测量,识别出四个现有框架未涵盖的潜在维度,并质疑一个既有维度;第三项为适用性检查,邀请专家评估系统的价值、可及性与适用性。ALIGNS免费开放于nomologicalnetwork.org,可与传统验证方法协同,实现大规模命名分析。

原文摘要 · Abstract (English)

Psychological measurement is critical to many disciplines. Despite advances in measurement, building nomological networks, theoretical maps of how concepts and measures relate to establish validity, remains a challenge 70 years after Cronbach and Meehl proposed them as fundamental to validation. This limitation has practical consequences: clinical trials may fail to detect treatment effects, and public policy may target the wrong outcomes. We introduce Analysis of Latent Indicators to Generate Nomological Structures (ALIGNS), a large language model-based system trained with validated questionnaire measures. ALIGNS provides three comprehensive nomological networks containing over 550,000 indicators across psychology, medicine, social policy, and other fields. This represents the first application of large language models to solve a foundational problem in measurement validation. We report classification accuracy tests used to develop the model, as well as three evaluations. In the first evaluation, the widely used NIH PROMIS anxiety and depression instruments are shown to converge into a single dimension of emotional distress. The second evaluation examines child temperament measures and identifies four potential dimensions not captured by current frameworks, and questions one existing dimension. The third evaluation, an applicability check, engages expert psychometricians who assess the system's importance, accessibility, and suitability. ALIGNS is freely available at nomologicalnetwork.org, complementing traditional validation methods with large-scale nomological analysis.

心理测量大模型应用命名网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。