arXiv:2605.15734cs.AI2026-05

检验大模型对用户状态判断的可靠性,发现多数指标不稳定。

Can We Trust AI-Inferred User States. A Psychometric Framework for Validating the Reliability of Users States Classification by LLMs in Operational Environments

论文配图:Can We Trust AI-Inferred User States. A Psychometric Framework for Validating the Reliability of Users States Classification by LLMs in Operational Environments
图 1 · 摘自论文原文
  • 构建可复现评估框架,检验三款大模型在多模态下的用户状态指标稳定性。
  • 仅31/213个指标满足个体可靠性标准,实时应用中不可信。
  • 不稳定的指标仍可用于事后分析,揭示交互规律与用户体验关系。

将大语言模型用于对话与自适应系统中评估用户状态,依赖于相关度量在个体层面具有稳定性和可解释性。本文通过重复性评估方法,检验了三种双模态大模型(GPT-4o audio、Gemini 2.0 Flash、Gemini 2.5 Flash)在用户状态度量上的可重复性。分析涵盖个体得分可靠性和聚合可靠性,以区分适用于实时自适应的指标与仅在聚合分析中有效的指标。结果表明,度量的可靠性不能被视为解释性领域的默认属性。个体得分缺乏稳定性,使这些分数无法作为实时自适应系统中用户状态的指示器,即使其聚合后表现稳定。同时,尽管个体不稳定,部分指标仍可在事后研究中保持分析价值,用于识别交互规则及其与满意度、信任感和参与度等用户体验参数的关系。本研究的主要贡献在于量化问题严重性(仅31/213个指标达标),并提出一个可复现的评估框架,支持对度量适用性的可测量评估。该方法推动更负责任的自适应系统设计,要求对结果解释进行明确的可靠性验证,并持续监测异常。

原文摘要 · Abstract (English)

The use of large language models to assess user states in conversational and adaptive systems is based on the assumption that the metrics used for such assessment are stable and interpretable at the level of individual scores. This paper empirically tests this assumption, focusing on the psychometric reliability of artificial intelligence (AI) measures of user states. This study employed replication evaluation procedures to assess the repeatability of a broad set of metrics across three different bimodal large language models (GPT-4o audio, Gemini 2.0 Flash, Gemini 2.5 Flash). Analyses include both individual score reliability and aggregated reliability, allowing us to distinguish metrics potentially useful for real-time adaptation from those that retain their value only in aggregated analyses. The results demonstrate that metric reliability cannot be considered a default property in interpretive domains. The lack of stability at the level of individual scores precludes the interpretation of such scores as indicators of user state in real-time adaptive systems, even if these metrics demonstrate stability after aggregation. At the same time, the study indicates that individually unstable metrics can retain analytical utility in post-hoc studies, identifying rules governing interactions and their relationships with user experience parameters such as satisfaction, trust, and engagement. The main contribution of this work, besides quantifying the severity of the problem (only 31 of 213 metrics met the criteria), is the proposal of a replicable evaluation framework, enabling measurable evaluations of metric applicability. This approach supports more responsible AI design of adaptive systems, in which the interpretation of results requires explicit validation of reliability and monitoring for violations over time.

心理计量大模型评估用户状态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。