通过风格分析提升大模型生成文本的检测准确率与可解释性
StyleDecipher: Robust and Explainable Detection of LLM-Generated Texts with Stylistic Analysis
- 融合离散风格特征与连续语义表征,统一建模人类与机器文本差异
- 跨领域测试中准确率领先基线36.30%,对混合内容仍保持鲁棒
- 无需模型内部信息或标注数据,结果可解释,适合内容审核场景
随着大语言模型在开放域写作中的广泛应用,检测机器生成文本已成为保障内容真实性的关键任务。现有方法依赖统计偏差或模型特定启发式规则,但在真实场景下泛化能力差、易受改写影响且缺乏可解释性,尤其在面对风格多样或人机混合创作时表现不佳。本文提出StyleDecipher,一种基于风格分析的鲁棒且可解释的检测框架。该框架通过联合建模离散风格指标与来自语义嵌入的连续风格表示,在统一表征空间中捕捉人类与大模型输出间的风格差异。实验在新闻、代码、论文、评论和学术摘要等五个不同领域验证表明,StyleDecipher在同域检测中达到当前最优性能;跨域评估中相比基线最高提升36.30%,且对对抗扰动和人机混合内容保持鲁棒。定性和定量分析进一步证明,风格信号可提供可信的判别依据。
原文摘要 · Abstract (English)
With the increasing integration of large language models (LLMs) into open-domain writing, detecting machine-generated text has become a critical task for ensuring content authenticity and trust. Existing approaches rely on statistical discrepancies or model-specific heuristics to distinguish between LLM-generated and human-written text. However, these methods struggle in real-world scenarios due to limited generalization, vulnerability to paraphrasing, and lack of explainability, particularly when facing stylistic diversity or hybrid human-AI authorship. In this work, we propose StyleDecipher, a robust and explainable detection framework that revisits LLM-generated text detection using combined feature extractors to quantify stylistic differences. By jointly modeling discrete stylistic indicators and continuous stylistic representations derived from semantic embeddings, StyleDecipher captures distinctive style-level divergences between human and LLM outputs within a unified representation space. This framework enables accurate, explainable, and domain-agnostic detection without requiring access to model internals or labeled segments. Extensive experiments across five diverse domains, including news, code, essays, reviews, and academic abstracts, demonstrate that StyleDecipher consistently achieves state-of-the-art in-domain accuracy. Moreover, in cross-domain evaluations, it surpasses existing baselines by up to 36.30%, while maintaining robustness against adversarial perturbations and mixed human-AI content. Further qualitative and quantitative analysis confirms that stylistic signals provide explainable evidence for distinguishing machine-generated text. Our source code can be accessed at https://github.com/SiyuanLi00/StyleDecipher.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。