无监督学习写作风格特征,有效识别AI文本并抵御对抗攻击。
Unsupervised Style Representation Learning for AI-Text Detection via Paraphrase Inversion

- 用机器改写的人类文本反向重建,提取非语义风格特征。
- 少样本检测性能超越所有基线,零样本下对未知LLM泛化能力强。
- 无需标注即可学风格,适合对抗攻击和跨模型检测场景。
大语言模型的快速发展引发了抄袭、虚假信息和自动化操纵等滥用问题,亟需可靠的检测手段。研究表明,基于神经网络的写作风格表征在检测中有效且对对抗攻击具有鲁棒性。然而现有风格检测器依赖作者标签训练,仅限于少量样本推理,且需分布内样本,实际中可能不可得。本文提出一种无监督方法:通过训练风格编码器从机器生成的改写文本中重建原始人类文本,训练时冻结语义编码器,迫使风格编码器仅捕捉重建所需的非语义特征。我们在两种检测策略下评估所学表征:少样本检测器与零样本DeepSVDD检测器。在多个基准测试中,该方法在少样本设置下表现持平或优于所有基线;在零样本场景下,其在分布内测试数据上媲美全监督分类器,且对未见大模型更具泛化能力。此外,所学表征还可迁移至未训练过的任务,在作者身份验证与细粒度风格区分上取得有竞争力的表现。
原文摘要 · Abstract (English)
The rapid development of large language models (LLMs) has raised concerns about misuse such as plagiarism, misinformation, and automated influence operations, motivating the need for robust detectors. Recent work has shown that neural representations of writing style are effective for detection and, crucially, robust to adversarial attacks that defeat most existing detectors. However, current style-based detectors rely on authorship labels for training, and are limited to few-shot inference for detection, requiring in-distribution samples that may not always be available. We learn discriminative style features without authorship labels by training a style encoder to reconstruct human-authored text from its machine-generated paraphrase; freezing a semantic encoder during training biases the style encoder to capture only the non-semantic features needed for reconstruction. We evaluate the learned representations via two detection strategies: a few-shot detector and a zero-shot DeepSVDD-based detector. Across benchmarks, our method matches or outperforms all baselines in the few-shot setting and, in the zero-shot regime, is competitive with fully supervised classifiers on in-distribution test data while generalizing better to unseen LLMs. Beyond detection, the learned representations generalize to unseen tasks, achieving competitive performance on authorship verification and fine-grained style discrimination despite never being trained on either objective.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。