通过情绪分布稳定性差异,无需训练即可识别大模型生成文本。
DSIPA: Detecting LLM-Generated Texts via Sentiment-Invariant Patterns Divergence Analysis

- 基于风格变化下情绪分布的稳定性差异,设计无监督检测机制。
- 在5个领域测试中,相比基线方法最高提升49.89%的检测准确率。
- 零样本黑盒运行,适合对抗攻击和跨领域场景下的内容安全检测。
大语言模型的快速发展带来了新型安全挑战,尤其是在虚假信息、身份冒用和内容伪造中的机器生成文本检测问题。现有方法在对抗扰动、改写攻击和领域迁移下鲁棒性差,且常需依赖模型参数或大量标注数据。为此,我们提出DSIPA——一种无需训练的新型框架,通过量化在受控风格变化下的情绪分布稳定性来检测大模型生成内容。该方法基于观察:大模型输出的情绪一致性更强,而人类写作则表现出更大的情感波动。框架采用两种无监督指标——情绪分布一致性与情绪分布保持性,以捕捉这种内在行为差异,无需参数更新或概率访问。在GPT-5.2、Gemini-1.5-pro、Claude-3和LLaMa-3.3等主流模型上进行实验,覆盖新闻、编程代码、学生作文、学术论文和社区评论共五个领域。结果表明,DSIPA在多个任务中相较基线方法最高提升49.89%的F1分数,展现出优异的泛化能力与对抗鲁棒性,为大模型时代的内容安全识别提供可靠且可解释的行为信号。
原文摘要 · Abstract (English)
The rapid advancement of large language models (LLMs) presents new security challenges, particularly in detecting machine-generated text used for misinformation, impersonation, and content forgery. Most existing detection approaches struggle with robustness against adversarial perturbation, paraphrasing attacks, and domain shifts, often requiring restrictive access to model parameters or large labeled datasets. To address this, we propose DSIPA, a novel training-free framework that detects LLM-generated content by quantifying sentiment distributional stability under controlled stylistic variation. It is based on the observation that LLMs typically exhibit more emotionally consistent outputs, while human-written texts display greater affective variation. Our framework operates in a zero-shot, black-box manner, leveraging two unsupervised metrics, sentiment distribution consistency and sentiment distribution preservation, to capture these intrinsic behavioral asymmetries without the need for parameter updates or probability access. Extensive experiments are conducted on state-of-the-art proprietary and open-source models, including GPT-5.2, Gemini-1.5-pro, Claude-3, and LLaMa-3.3. Evaluations on five domains, such as news articles, programming code, student essays, academic papers, and community comments, demonstrate that DSIPA improves F1 detection scores by up to 49.89% over baseline methods. The framework exhibits superior generalizability across domains and strong resilience to adversarial conditions, providing a robust and interpretable behavioral signal for secure content identification in the evolving LLM landscape.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。