arXiv:2606.00016cs.CLcs.AI2026-06

用注意力图谱区分人类与AI文本,提升检测准确性。

AEyeDE: An Attention-Based Attribution Framework for AI-Generated Text Detection

论文配图:AEyeDE: An Attention-Based Attribution Framework for AI-Generated Text Detection
图 1 · 摘自论文原文
  • 通过代理模型提取文本注意力图谱作为判别信号。
  • 在多种场景下均优于纯文本基线,跨数据集迁移性强。
  • 注意力模式有规律差异,适合可解释性检测研究者。

随着语言模型日益接近人类水平的流畅度,基于表面统计或似然信号的生成文本检测方法面临挑战。本文提出AEyeDE,一种基于注意力归因的人类与AI作者身份识别框架。通过具有白盒访问权限的代理Transformer模型,提取人类与AI生成文本的注意力归因矩阵,并训练轻量级卷积神经网络从这些归因图中学习表征。在编码器-解码器翻译任务中,该方法持续优于仅使用文本的基线模型;在解码器仅模型设置下,对特定生成器检测表现强劲,在标准基准上保持竞争力,并展现出对跨数据集迁移和变体拼写扰动的鲁棒性。进一步发现,注意力图谱存在重复出现的局部结构,其相对频率在不同数据集和代理模型间均稳定区分人类与AI文本。这表明注意力归因图谱可作为互补且可解释的检测信号。代码将公开以支持后续研究。

原文摘要 · Abstract (English)

Detecting AI-generated text is becoming increasingly challenging as modern language models approach human-level fluency and can evade detectors that rely on surface statistics or likelihood-based signals. We propose \textsc{AEyeDE}, an attribution-driven approach to human-AI authorship detection that leverages model attention as a discriminative signal. Specifically, we extract attention-based attribution matrices for both human- and AI-generated text using a \emph{proxy} Transformer model with white-box access and train a lightweight Convolutional Neural Network to learn representations from these attribution maps. Across encoder-decoder translation settings, our method consistently outperforms a text-only baseline. In decoder-only settings, it performs strongly in generator-specific detection, remains competitive on standard benchmarks, and shows robustness under cross-dataset transfer and alternative-spelling perturbations. We further show that attention maps exhibit recurring local structures whose relative frequencies differ consistently between human- and AI-generated text across datasets and proxy models. These findings suggest that attention-based attribution maps provide a complementary and interpretable signal for AI-generated text detection. We will make the code publicly available to support future research.

文本检测注意力机制可解释性AI生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。