arXiv:2509.18862cs.CL2025-09被引 1

多层级特征融合对大模型文本检测提升有限,但能稳定保持高精度。

Multi-Hierarchical Feature Detection for Large Language Model Generated Text

  • 融合语义、句法与统计特征,通过自适应方式集成多层级信息。
  • 跨领域检测准确率达84.2%,仅比现有方法提升0.4%-2.6%。
  • 虽理论上有互补性,但计算开销大(4.2倍),收益微弱,不值得投入。

随着大语言模型技术的快速发展,人们越来越关注多特征方法能否在人工智能生成文本检测上超越单一神经模型的表现。尽管直觉认为语义、句法和统计特征应提供互补信号,但这一假设尚未在现代大模型生成文本上得到严谨验证。本文系统地研究了多层级特征融合在AI文本检测中的有效性,重点考察其带来的性能增益是否足以抵消计算开销。我们实现了MHFD(Multi-Hierarchical Feature Detection),通过自适应融合基于DeBERTa的语义分析、句法解析及统计概率特征。实验结果表明:尽管理论上具有互补性,但多特征融合仅带来0.4%-0.5%的微弱提升,而计算开销高达4.2倍。在多个基准数据集上,MHFD实现89.7%的域内检测准确率,并在跨域检测中保持84.2%的稳定表现,优于现有方法0.4%-2.6%。

原文摘要 · Abstract (English)

With the rapid advancement of large language model technology, there is growing interest in whether multi-feature approaches can significantly improve AI text detection beyond what single neural models achieve. While intuition suggests that combining semantic, syntactic, and statistical features should provide complementary signals, this assumption has not been rigorously tested with modern LLM-generated text. This paper provides a systematic empirical investigation of multi-hierarchical feature integration for AI text detection, specifically testing whether the computational overhead of combining multiple feature types is justified by performance gains. We implement MHFD (Multi-Hierarchical Feature Detection), integrating DeBERTa-based semantic analysis, syntactic parsing, and statistical probability features through adaptive fusion. Our investigation reveals important negative results: despite theoretical expectations, multi-feature integration provides minimal benefits (0.4-0.5% improvement) while incurring substantial computational costs (4.2x overhead), suggesting that modern neural language models may already capture most relevant detection signals efficiently. Experimental results on multiple benchmark datasets demonstrate that the MHFD method achieves 89.7% accuracy in in-domain detection and maintains 84.2% stable performance in cross-domain detection, showing modest improvements of 0.4-2.6% over existing methods.

文本检测大模型特征融合效率评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。