通过对比学习增强风格表示,让大模型文本指纹更抗干扰。
T5-CSBoost: Adversarial Perturbation Resistant LLM Fingerprinting

- 用对比损失约束解码器嵌入,学习紧凑抗扰风格特征。
- 在90%强度对抗扰动下仍保持高精度,优于现有方法。
- 适合需要真实场景鲁棒性的文本溯源与伪造检测任务。
尽管许多AI生成文本检测器在干净输入上表现良好,但在轻微改写、词语替换、字符编辑和分布偏移下准确率显著下降。我们提出T5-CSBoost,作为T5-Sentinel框架的扩展,在保持原始下一个词预测目标用于源归属的同时,引入基于边距的三元组损失于解码器嵌入上。这种对比风格正则化促使学习到紧凑且抗扰的风格表示,提供一种轻量级有效方案,无需修改架构、对抗训练或复杂多任务目标即可提升鲁棒性。T5-CSBoost在OpenLLMText和HC3 AIGT基准上实现多类源归属与二分类人机检测的最先进性能。更重要的是,其对高达90%强度的词级与字符级对抗扰动具有显著鲁棒性,在MAGE/Deepfake压力测试套件中表现优异,涵盖未见模型、未见领域及极端改写场景。结果表明,通过对比学习显式正则化风格嵌入是构建现实对抗环境下更鲁棒大模型指纹系统的实用有效策略。
原文摘要 · Abstract (English)
While many AI-generated text (AIGT) detectors achieve strong performance on clean inputs, their accuracy degrades significantly under light paraphrasing, word substitutions, character edits, and distribution shifts. We present T5 Contrastive Style Boosted Classifier (T5-CSBoost), an extension to the T5-Sentinel framework that keeps the original next-token prediction objective for source attribution while introducing an auxiliary margin-based triplet loss over decoder embeddings. This contrastive style regularization encourages the learning of compact, perturbation-resistant stylistic representations, offering a lightweight yet effective alternative to prior approaches that rely on architectural modifications, adversarial training, or complex multi-task objectives without altering the underlying T5-small backbone. T5-CSBoost achieves state-of-the-art multiclass source attribution and binary human-vs-LLM detection on OpenLLMText and HC3 AIGT benchmarks. More importantly, T5-CSBoost demonstrates enhanced robustness to word and character level adversarial perturbations of up to 90% intensity, achieving state-of-the-art on the challenging MAGE/Deepfake stress-test suite, including unseen models, unseen domains, and extreme paraphrasing scenarios. Our results highlight that explicitly regularizing stylistic embeddings via contrastive learning is a practical and effective strategy for building more robust LLM fingerprinting systems in real-world adversarial settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。