arXiv:2509.08920cs.CLstat.AP2025-09被引 1

用大模型把文章当人、词语当题,挖掘文本背后隐藏的知识结构。

Documents Are People and Words Are Items: A Psychometric Approach to Textual Data with Contextual Embeddings

  • 将文档视为个体,词语视为测试题,用上下文嵌入生成可分析的评分数据。
  • 在Wiki STEM数据集上识别出多个知识维度,揭示文本中潜在的隐性结构。
  • 适合教育评估、心理测量和法律文本分析等需深度理解语义的研究者。

本研究提出一种基于大语言模型的新型心理测量方法,用于分析文本数据。通过利用上下文嵌入生成上下文得分,将文本数据转化为适合心理测量分析的响应数据。在假设下,某些关键词在不同文档中的上下文意义差异显著,能有效区分语料库内的文档。该方法分为两个阶段:第一阶段使用自然语言处理技术与基于编码器的Transformer模型识别常见关键词并生成上下文得分;第二阶段采用多种因子分析方法(包括探索性因子分析与双因子模型)提取和定义潜在因子,确定因子相关性,并识别每个因子最相关的词。在Wiki STEM语料库上的实验结果表明,该方法能有效揭示文本数据中的潜在知识维度与模式。此方法不仅提升了文本的心理测量分析能力,也为教育、心理学、法律等富含文本信息的领域提供了新工具。

原文摘要 · Abstract (English)

This research introduces a novel psychometric method for analyzing textual data using large language models. By leveraging contextual embeddings to create contextual scores, we transform textual data into response data suitable for psychometric analysis. Treating documents as individuals and words as items, this approach provides a natural psychometric interpretation under the assumption that certain keywords, whose contextual meanings vary significantly across documents, can effectively differentiate documents within a corpus. The modeling process comprises two stages: obtaining contextual scores and performing psychometric analysis. In the first stage, we utilize natural language processing techniques and encoder based transformer models to identify common keywords and generate contextual scores. In the second stage, we employ various types of factor analysis, including exploratory and bifactor models, to extract and define latent factors, determine factor correlations, and identify the most significant words associated with each factor. Applied to the Wiki STEM corpus, our experimental results demonstrate the method's potential to uncover latent knowledge dimensions and patterns within textual data. This approach not only enhances the psychometric analysis of textual data but also holds promise for applications in fields rich in textual information, such as education, psychology, and law.

心理测量文本分析大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。