提出双维度量表LLM-D12,区分人对大模型的工具依赖与情感依赖。
LLM-D12: A Dual-Dimensional Scale of Instrumental and Relational Dependencies on Large Language Models
- 构建双因子量表:工具依赖与关系依赖,各6项
- 526名英国参与者验证,信度效度良好
- 适合研究大模型使用成瘾或人机关系的学者
当前对大模型(LLMs)依赖的研究多沿用传统成瘾症状框架,但该框架未能捕捉人机关系的复杂性。为此,我们开发并验证了12项新量表LLM-D12,基于前期理论构建,从526名英国参与者中收集数据。通过分样本探索性与验证性因子分析,确认其双因子结构:工具依赖(6项)反映用户在决策与认知任务中对大模型的依赖程度;关系依赖(6项)体现用户将大模型视为具有社会意义、类人或伴侣式存在的倾向。两个维度内部一致性高,区分效度清晰。外部验证支持其理论基础及两维度的独立性。研究指出,大模型依赖未必代表功能障碍,但在特定情境下可能带来问题。
原文摘要 · Abstract (English)
There is growing interest in understanding how people interact with large language models (LLMs) and whether such models elicit dependency or even addictive behaviour. Validated tools to assess the extent to which individuals may become dependent on LLMs are scarce and primarily build on classic behavioral addiction symptoms, adapted to the context of LLM use. We view this as a conceptual limitation, as the LLM-human relationship is more nuanced and warrants a fresh and distinct perspective. To address this gap, we developed and validated a new 12-item questionnaire to measure LLM dependency, referred to as LLM-D12. The scale was based on the authors' prior theoretical work, with items developed accordingly and responses collected from 526 participants in the UK. Exploratory and confirmatory factor analyses, performed on separate halves of the total sample using a split-sample approach, supported a two-factor structure: Instrumental Dependency (six items) and Relationship Dependency (six items). Instrumental Dependency reflects the extent to which individuals rely on LLMs to support or collaborate in decision-making and cognitive tasks. Relationship Dependency captures the tendency to perceive LLMs as socially meaningful, sentient, or companion-like entities. The two-factor structure demonstrated excellent internal consistency and clear discriminant validity. External validation confirmed both the conceptual foundation and the distinction between the two subscales. The psychometric properties and structure of our LLM-D12 scale were interpreted in light of the emerging view that dependency on LLMs does not necessarily indicate dysfunction but may still reflect reliance levels that could become problematic in certain contexts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。