用小波分析文本概率波动,零训练检测大模型生成文本
DWT-Fusion: A Signal-Based Framework for Training-Free LLM-Generated Text Detection

- 通过小波变换分析词元概率序列的多尺度局部变化
- 单模型最高达0.9872的AUROC,融合后提升至0.9919
- 无需训练即可跨数据集、跨模型通用,适合快速部署
在零样本和无训练条件下检测大语言模型生成文本仍具挑战性,尤其当检测器需在不同数据集、领域和未见生成器间保持泛化能力时。现有无训练方法虽利用语言模型统计特征作为检测信号,但通常依赖全局统计量概括整体模型行为,忽略了词元级可预测性中的局部与多尺度变化信息。为此,本文提出DWT-Fusion框架,基于代理因果语言模型输出的词元级对数概率序列,采用离散小波变换进行多分辨率信号分析,从中提取局部概率动态作为检测信号。进一步评估四种无训练投票策略:等权硬投票、等权软投票、校准加权硬投票与校准加权软投票,以融合多个小波配置结果,无需训练监督元分类器。在HC3、M4和MAGE数据集上,使用GPT-Neo-2.7B、GPT-J-6B、Falcon-7B和LLaMA-3-8B作为代理模型进行测试。最优单个小波配置在三数据集上的AUROC分别为0.9872、0.8185和0.7138;经校准加权投票后,集成方案进一步提升至0.9919、0.8477和0.7471。结果表明,基于小波的多分辨率评分与校准引导投票融合,能提供有效且可解释的无训练检测信号。
原文摘要 · Abstract (English)
Detecting LLM-generated text remains challenging under zero-shot and training-free conditions, especially when detectors must generalize across datasets, domains, and unseen generators. While existing training-free approaches exploit language-model statistics as detection signals, they typically characterize a text through global measures that summarize overall model behavior. Consequently, potentially informative local and multiscale variations in token-level predictability may remain underutilized. Motivated by this observation, we introduce DWT-Fusion, a training-free signal-based framework for detecting LLM-generated text using discrete wavelet analysis of token-level log-probability sequences produced by a proxy causal language model. The proposed framework analyzes these sequences through wavelet-based multiresolution signal representations and derives detection signals from localized probability dynamics. We further evaluate four training-free voting variants, including equal-weight hard voting, equal-weight soft voting, calibration-weighted hard voting, and calibration-weighted soft voting, to combine multiple wavelet configurations without training a supervised meta-classifier. We evaluate the framework on HC3, M4, and MAGE using GPT-Neo-2.7B, GPT-J-6B, Falcon-7B, and LLaMA-3-8B as proxy models. The best single wavelet configurations achieve AUROC values of 0.9872, 0.8185, and 0.7138 on HC3, M4, and MAGE, respectively. With calibration-weighted voting, the best ensemble variants further improve AUROC to 0.9919, 0.8477, and 0.7471. These findings show that DWT-based multiresolution scoring and calibration-guided voting fusion provide effective and interpretable signals for training-free LLM-generated text detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。