MELD提升文本生成检测的鲁棒性,应对对抗攻击与新模型泛化挑战。
MELD: Multi-Task Equilibrated Learning Detector for AI-Generated Text

- 多任务均衡学习,同时识别生成器、攻击类型和来源域以增强表征。
- 在低误报率下仍保持99.9%查全率,对抗攻击下表现优于多数基线。
- 无需微调即可适应新大模型,适合学术诚信与内容审核场景。
大型语言模型已嵌入日常写作流程,可靠检测AI生成文本对学术诚信、内容审核和来源追踪至关重要。然而,检测器不仅需在干净分布的人类与AI文本上取得高平均AUROC,还应具备对抗攻击、跨生成器与跨领域迁移能力,并维持低误报率(FPR)。现有检测器多仅优化二分类任务,一旦饱和便缺乏学习生成器、攻击或领域结构的动力。本文提出MELD(多任务均衡学习检测器),在共享编码器上附加生成器家族、攻击类型和源域头,通过可学习同方差不确定性权重平衡四类损失。为提升鲁棒性,采用EMA教师模型预测干净输入,攻击增强学生模型向教师蒸馏;同时引入硬负样本成对排序损失,扩大AI文本与最易混淆人类文本的得分差距。推理时所有辅助头被丢弃,接口与成本与标准检测器一致。在公开RAID排行榜上,MELD是性能最强的开源检测器,且在对抗攻击与低FPR条件下媲美领先商业模型。在标准保留基准上,其表现匹配或超越监督基线。我们进一步构建了MELD-eval评估池,涵盖四大主流厂商最新聊天模型。无需微调,MELD在该池上实现1% FPR下99.9%查全率,而多数基线显著下降。
原文摘要 · Abstract (English)
Large language models are now embedded in everyday writing workflows, making reliable AI-generated text detection important for academic integrity, content moderation, and provenance tracking. In practice, however, a detector must do more than achieve high aggregate AUROC on clean, in-distribution human and AI text: it should remain robust to attacks and adversarial rewrites, transfer to unseen generators and domains, and operate at low false-positive rates (FPR). Most existing detectors optimize a single AI/Human objective, giving the representation little incentive to learn generator, attack, or domain structure once the binary task saturates. We introduce MELD (Multi-Task Equilibrated Learning Detector), a deployable detector for AI-generated text that enriches binary detection with auxiliary supervision. MELD attaches generator-family, attack-type, and source-domain heads to a shared encoder, and balances the four losses with learned homoscedastic uncertainty weights. To improve robustness, an EMA teacher predicts on clean inputs while an attack-augmented student is distilled toward the teacher. MELD further uses a hard-negative pairwise ranking loss to enlarge the score margin between AI-generated texts and the most confusable human texts. At inference, all auxiliary heads are discarded, giving MELD the same interface and cost as a standard detector. On the public RAID leaderboard, MELD is the strongest open-source detector and is competitive with leading commercial models, especially under attack and at low FPR. Across standard held-out benchmarks, MELD matches or outperforms supervised baselines. We further introduce MELD-eval, a held-out evaluation pool built from recent chat models released by four major LLM providers. Without additional finetuning, MELD achieves 99.9% TPR at 1% FPR on MELD-eval, while many baselines degrade sharply.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。