arXiv:2510.17489cs.CLcs.LG2025-10NeurIPS被引 11

通过树形结构建模人机协作文本的层次关系,提升检测准确性与泛化能力。

DETree: DEtecting Human-AI Collaborative Texts via Tree-Structured Hierarchical Representation Learning

  • 构建层级亲和树,捕捉不同人机协作文本的内在关联
  • 在真实混合文本数据集上实现更优的少样本检测性能
  • 适合需要高鲁棒性检测工具的研究者与平台方

检测人机协作生成文本对遏制虚假信息、剽窃和学术不端至关重要。然而,人机协作文本涉及多样化的生成过程(如人类撰写后由AI修改、人类文本经AI润色、纯AI生成再经其他AI优化等),且可能使用不同或新型大模型,导致文本特征复杂多变。现有方法仅采用二分类或简单多分类,难以刻画其内在结构。本文观察到不同生成过程的文本表示存在天然聚类关系,提出DETee,通过树状层次亲和结构建模这些关系,并设计专用损失函数使文本表征与该树结构对齐。为支持学习,构建了涵盖多种人机协作场景的综合基准数据集RealBench。实验表明,该方法在混合文本检测任务中表现更优,在分布外(OOD)及少样本条件下显著提升鲁棒性与泛化能力,验证了基于训练的方法在复杂场景下的潜力。代码与数据集已开源。

原文摘要 · Abstract (English)

Detecting AI-involved text is essential for combating misinformation, plagiarism, and academic misconduct. However, AI text generation includes diverse collaborative processes (AI-written text edited by humans, human-written text edited by AI, and AI-generated text refined by other AI), where various or even new LLMs could be involved. Texts generated through these varied processes exhibit complex characteristics, presenting significant challenges for detection. Current methods model these processes rather crudely, primarily employing binary classification (purely human vs. AI-involved) or multi-classification (treating human-AI collaboration as a new class). We observe that representations of texts generated through different processes exhibit inherent clustering relationships. Therefore, we propose DETree, a novel approach that models the relationships among different processes as a Hierarchical Affinity Tree structure, and introduces a specialized loss function that aligns text representations with this tree. To facilitate this learning, we developed RealBench, a comprehensive benchmark dataset that automatically incorporates a wide spectrum of hybrid texts produced through various human-AI collaboration processes. Our method improves performance in hybrid text detection tasks and significantly enhances robustness and generalization in out-of-distribution scenarios, particularly in few-shot learning conditions, further demonstrating the promise of training-based approaches in OOD settings. Our code and dataset are available at https://github.com/heyongxin233/DETree.

文本检测人机协作层次建模少样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。