arXiv:2509.12416cs.LGstat.AP2025-09被引 1

用低维表示解决文本图像标注中的偏差问题,提升分析精度

Surrogate Representation Inference for Text and Image Annotations

  • 构建代理表示框架,利用数据低维特征降低标注误差
  • 模拟与真实数据均显示标准误降低超50%
  • 适合有机器标注但含人为误差的研究场景

随着研究者越来越多地使用机器学习模型和大语言模型对文本、图像等非结构化数据进行标注,现有方法在修正下游统计分析偏差方面存在局限,常导致较大标准误且需无误差的人工标注。本文提出代理表示推断(SRI),假设非结构化数据完全中介人类标注与结构变量间的关系,该假设在标注者仅依赖非结构化数据时可保证成立。在此设定下,提出一种神经网络架构,学习非结构化数据的低维表示,使代理假设持续满足。当存在多个人工标注时,SRI可进一步校正标注中可能存在的非差异性测量误差。聚焦文本作为结果的情形,本文形式化建立了识别条件与半参数高效估计策略,实现低维表示的学习与利用。仿真与真实世界应用表明,当机器分类准确度中等时,SRI可使标准误减少超过50%,且在人工标注含非差异性测量误差时仍能提供有效推断。

原文摘要 · Abstract (English)

As researchers increasingly rely on machine learning models and LLMs to annotate unstructured data, such as texts or images, various approaches have been proposed to correct bias in downstream statistical analysis. However, existing methods tend to yield large standard errors and require some error-free human annotation. In this paper, I introduce Surrogate Representation Inference (SRI), which assumes that unstructured data fully mediate the relationship between human annotations and structured variables. The assumption is guaranteed by design provided that human coders rely only on unstructured data for annotation. Under this setting, I propose a neural network architecture that learns a low-dimensional representation of unstructured data such that the surrogate assumption remains to be satisfied. When multiple human annotations are available, SRI can be extended to further correct non-differential measurement errors that may exist in human annotations. Focusing on text-as-outcome settings, I formally establish the identification conditions and semiparametric efficient estimation strategies that enable learning and leveraging such a low-dimensional representation. Simulation studies and a real-world application demonstrate that SRI reduces standard errors by over 50% when machine learning classification accuracy is moderate and provides valid inference even when human annotations contain non-differential measurement errors.

标注偏差代理表示低维表示统计推断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。