arXiv:2608.28597cs.AIcs.CY2026-08

AI可绕过问卷注意力检查,暴露数据质量隐患

The Race between Agentic AI Capabilities and Data Quality Control in Online Surveys

论文配图:The Race between Agentic AI Capabilities and Data Quality Control in Online Surveys
图 1 · 摘自论文原文
  • 用多模态代理自动完成在线问卷并解析注意力检测
  • 暴露的DOM元数据使AI准确率超90%通过检测
  • 建议混淆DOM元数据以增强防御,适合研究者参考

在线问卷是多个领域基础的数据收集工具,注意力检查是保障响应质量的关键手段。然而,具目标导向能力的代理型AI(由大语言模型和/或多模态处理单元驱动,具备工具增强功能)的迅速发展,对这些防护机制的鲁棒性提出了新挑战。本文研究代理型AI在完成网络问卷并通过标准注意力检查方面的表现。评估了一个具备多模态输入处理与基于工具的网页交互能力的单代理架构,在受控问卷沙箱环境中进行测试。从攻击角度分析,揭示了如暴露的DOM元数据和可预测的选项编码等结构漏洞,使代理仅通过结构化解析即可通过注意力检查。从防御角度,提出一种移除文本题语义线索的DOM元数据混淆策略。评估多个开源语言与多模态模型,分析其能力与编排效果。基于评估结果,为实证研究者与代理型AI研究者提供兼顾双方需求的实践建议。

原文摘要 · Abstract (English)

Online surveys are a foundational data collection instrument in a variety of fields, with attention checks serving as critical guardians of response quality. However, the rapid emergence of agentic AI (goal directed systems powered by a large language model (LLM) brain and/or a multimodal processing unit with tool-augmented capabilities) raises new questions about the robustness of these safeguards. We investigate how well agentic AI architectures can complete web-based surveys and pass standard attention checks. We evaluate a single-agent architecture capable of multimodal input processing and tool-based web interaction on a controlled survey sandbox. We analyze the problem from two perspectives. From an attack perspective, we demonstrate how structural vulnerabilities such as exposed DOM metadata and predictable option encoding allow agents to resolve attention checks through structured parsing only. From a defense perspective, we implement a mitigation strategy of DOM metadata obfuscation to remove semantic cues in text-based questions. We evaluate multiple open-source language and multimodal models to study capability and orchestration effectiveness. Based on our evaluations, we offer perspectives on how to simultaneously meet the needs of empiricists and agentic AI researchers.

代理AI问卷安全数据质量注意力检查

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。