arXiv:2605.27921cs.AIcs.CL2026-05

让AI检测文本时自带解释,帮用户判断作者身份。

Show, Don't TELL: Explainable AI-Generated Text Detection

论文配图:Show, Don't TELL: Explainable AI-Generated Text Detection
图 1 · 摘自论文原文
  • 设计可解释的检测模型TELL,直接展示判断依据
  • 在真实数据集上达0.927的AUROC,效果领先
  • 解释内容符合人类认知,适合教育、审稿等场景

现有AI生成文本检测方法虽能准确区分人写与机器写,但输出仅为数值评分,缺乏解释,难以满足教授等用户需求。本文提出TELL架构,从底层设计就融入可解释性:在保持数值评分可比性的前提下,系统主动展示判断依据(即“tells”),使用户能基于自身对上下文和作者背景的理解自主决策。模型在自建的领域特定作者标注数据集上进行监督微调,并通过课程学习的GRPO进一步优化。实验显示其性能达到当前最优水平(AUROC 0.927),且生成的解释在可读性、可证伪性、连贯性、合理性与真实性方面获得人类标注者72.3%的胜率,显著优于传统方法。本工作将检测任务转向以人为核心,为未来具备原生可解释性的检测器提供了新范式。

原文摘要 · Abstract (English)

Research on AI-generated text detection has presented a number of approaches to discern human from AI prose, some of which achieving high in-distribution performance. However, real-world applicability has stalled because their outputs are misaligned with the needs of users, such as professors, who are presented with a numeric score that has no attached explanation. We tackle this issue with a novel architecture, TELL, that bakes explainability from the ground-up. While our system still offers a numerical score like other detectors for comparability, TELL takes a fundamentally different approach where we aim to show the user the "tells" by which the model believes a text is AI or human-written, to empower the user to decide who wrote a text using their own judgment and understanding of the context of the writing and its alleged author. We train TELL on a custom SFT dataset of domain-specific authorship annotations, and further refine the system using GRPO with curriculum learning to improve performance. We achieve competitive performance with state-of-the-art detectors (AUROC 0.927) while natively providing annotations that explain the basis for the detector's decision. We further evaluate the quality of our explanations using a dataset of human annotations and report a high (mean 72.3%) win-rate on annotation concreteness, falsifiability, coherence, plausibility and grounding, allowing users to critically think and decide for themselves. Our work thus reframes the problem of AI-generated text detection in a human-centric perspective and paves the way for a new family of detectors that focus on native explainability.

可解释AI文本检测人机交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。