用大模型生成更精准的领导力分析主题,提升可解释性与一致性。
Proposing Topic Models and Evaluation Frameworks for Analyzing Associations with External Outcomes: An Application to Leadership Analysis Using Large-Scale Corporate Review Data

- 基于大语言模型生成具象化、立场一致的主题
- 在员工评价数据中显著提升主题可解释性与解释力
- 适合需要关联文本主题与实际绩效的研究者
分析文本主题与外部结果的关系在计算社会科学和组织研究中至关重要。然而,现有主题模型难以同时保证可解释性、主题具体性(与具体行为或特征对齐)和极性一致性(主题内无正负混杂评价)。本研究以日本主流企业评论平台OpenWork的员工评价数据为对象,提出一种利用大语言模型生成满足上述特性的主题方法,并构建专门针对外部结果分析的评估框架。该框架将主题具体性和极性一致性作为核心评价指标,检验基于现有度量的自动化评估方法。实验表明,相比现有方法,该方法在可解释性、具体性和极性一致性上均有提升,且在员工士气等外部结果分析中表现出更强的解释力。结果表明,该方法与评估框架可推广至涉及外部结果的主题分析场景。
原文摘要 · Abstract (English)
Analyzing topics extracted from text data in relation to external outcomes is important across fields such as computational social science and organizational research. However, existing topic modeling methods struggle to simultaneously achieve interpretability, topic specificity (alignment with concrete actions or characteristics), and polarity stance consistency (absence of mixed positive and negative evaluations within a topic). Focusing on leadership analysis using corporate review data, this study proposes a method leveraging large language models to generate topics that satisfy these properties, along with an evaluation framework tailored to external outcome analysis. The framework explicitly incorporates topic specificity and polarity stance consistency as evaluation criteria and examines automated evaluation methods based on existing metrics. Using employee reviews from OpenWork, a major corporate review platform in Japan, the proposed method achieves improved interpretability, specificity, and polarity consistency compared to existing approaches. In analyses of external outcomes such as employee morale, it also produces topics with higher explanatory power. These results suggest that the proposed method and evaluation framework provide a generalized approach for topic analysis in applications involving external outcomes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。