AI写作检测器对不同学生群体误判率高,根源在于检测逻辑本身存在结构性局限。
AI Detectors Fail Diverse Student Populations: A Mathematical Framing of Structural Detection Limits
- 将检测问题重新建模为复合零假设,揭示检测本质限制
- 证明任何单次文本检测器都必然产生与学生写作风格重叠相关的误判
- 建议检测结果不应作为学术不端定罪的唯一依据
学生体验和实证研究显示,'黑箱'AI文本检测器在特定学生群体中产生高误报率,但现有理论通常将检测建模为人类与AI文本分布之间的二元检验。该框架忽略了大学评估中评估者通常不了解个体学生写作风格分布这一结构特征,导致零假设为复合型。对总变差距离的变分表征应用于此复合零假设,揭示了任意具有实际检测效能的单次文本检测器,其误判率受学生写作与AI输出分布重叠程度的严格约束。这一限制源于群体多样性,与AI模型质量无关,无法通过改进检测技术克服。子群混合界将这些量与可观察的人口统计群体关联,为实证中记录的差异性影响提供了理论基础。本文提出改进政策与实践的建议,主张检测分数不应作为学术不端调查的唯一证据。
原文摘要 · Abstract (English)
Student experiences and empirical studies report that "black box" AI text detectors produce high false positive rates with disproportionate errors against certain student populations, yet typically theoretical analyses model detection as a test between two known distributions for human and AI prose. This framing omits the structural feature of university assessment whereby an assessor generally does not know the individual student's writing distribution, making the null hypothesis composite. Standard application of the variational characterisation of total variation distance to this composite null shows trade-off bounds that any text-only, one-shot detector with useful power must produce false accusations at a rate governed by the distributional overlap between student writing and AI output. This is a constraint arising from population diversity that is logically independent of AI model quality and cannot be overcome by better detector engineering or technology. A subgroup mixture bound connects these quantities to observable demographic groups, providing a theoretical basis for the disparate impact patterns documented empirically. We propose suggestions to improve policy and practice, and argue that detection scores should not serve as sole evidence in misconduct proceedings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。