arXiv:2603.02427cs.HCcs.AI2026-03综述

无需标签,通过结构分析自动识别问卷中不认真作答者。

Learning to Pay Attention: Unsupervised Modeling of Attentive and Inattentive Respondents in Survey Data

  • 用自编码器和概率图模型从答题一致性中无监督建模注意力状态。
  • 在9个真实数据集上,线性模型即可有效区分专注与不专注回答者。
  • 发现问卷设计质量直接影响算法检测效果,适合调查平台质量审计。

行为与社会科学问卷的可靠性依赖于识别提供随意或低努力答案的不认真应答者。传统方法如注意力检查成本高、反应迟缓且不一致。本文提出统一的无标签框架,通过几何重构(自编码器)与概率依赖建模(Chow-Liu树)双重无监督视角评估答题连贯性。我们引入“百分位损失”提升自编码器对异常值的鲁棒性,但主要贡献在于揭示了无监督质量控制的结构性条件:在九个异构真实数据集中,检测效果更多取决于问卷结构而非模型复杂度——具有连贯重叠题项的问卷表现出强协方差模式,即使线性模型也能可靠区分专注与不专注应答者。这揭示了关键的“心理测量-机器学习对齐”现象:最大化测量信度的设计原则(如内部一致性)也最有利于算法检测。该框架为调查平台提供了可扩展、领域无关的质量诊断工具,直接关联数据质量与问卷设计,实现无额外应答负担的审计。

原文摘要 · Abstract (English)

The integrity of behavioral and social-science surveys depends on detecting inattentive respondents who provide random or low-effort answers. Traditional safeguards, such as attention checks, are often costly, reactive, and inconsistent. We propose a unified, label-free framework for inattentiveness detection that scores response coherence using complementary unsupervised views: geometric reconstruction (Autoencoders) and probabilistic dependency modeling (Chow-Liu trees). While we introduce a "Percentile Loss" objective to improve Autoencoder robustness against anomalies, our primary contribution is identifying the structural conditions that enable unsupervised quality control. Across nine heterogeneous real-world datasets, we find that detection effectiveness is driven less by model complexity than by survey structure: instruments with coherent, overlapping item batteries exhibit strong covariance patterns that allow even linear models to reliably separate attentive from inattentive respondents. This reveals a critical ``Psychometric-ML Alignment'': the same design principles that maximize measurement reliability (e.g., internal consistency) also maximize algorithmic detectability. The framework provides survey platforms with a scalable, domain-agnostic diagnostic tool that links data quality directly to instrument design, enabling auditing without additional respondent burden.

问卷质量无监督学习心理测量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。