arXiv:2410.14259cs.CL2024-10中稿 · WWW2025被引 21

提出角色识别与影响度测量,实现对大模型生成内容的精细检测。

Beyond Binary: Towards Fine-Grained LLM-Generated Text Detection via Role Recognition and Involvement Measurement

  • 引入多分类角色识别与回归式影响度测量新任务
  • 在五个跨场景和两种强度变化下验证模型泛化能力
  • 发现微调PLM模型表现最优,大模型自检能力弱

大语言模型(如ChatGPT)的快速发展导致其生成内容在社交媒体上广泛存在,引发虚假信息、数据偏见和隐私泄露等问题,削弱网络对话信任。现有检测方法多聚焦二元分类,难以应对人类与大模型协作等真实场景的复杂性。为此,本文提出一种新范式:引入两个新任务——大模型角色识别(LLM-RR,多分类)与大模型影响度测量(LLM-IM,回归),以刻画生成过程中大模型的具体角色及其参与程度。为此构建了基准数据集LLMDetect,包含用于训练的混合新闻检测语料库(HNDC)以及涵盖五类跨场景和两类多强度变化的DetectEval评估套件,全面评估检测器的泛化与鲁棒性。10种基线方法实证表明,微调的PLM模型在两项任务中持续领先,而先进大模型在自检测时表现不佳。研究为更精准的内容检测提供了新思路与评估基础。

原文摘要 · Abstract (English)

The rapid development of large language models (LLMs), like ChatGPT, has resulted in the widespread presence of LLM-generated content on social media platforms, raising concerns about misinformation, data biases, and privacy violations, which can undermine trust in online discourse. While detecting LLM-generated content is crucial for mitigating these risks, current methods often focus on binary classification, failing to address the complexities of real-world scenarios like human-LLM collaboration. To move beyond binary classification and address these challenges, we propose a new paradigm for detecting LLM-generated content. This approach introduces two novel tasks: LLM Role Recognition (LLM-RR), a multi-class classification task that identifies specific roles of LLM in content generation, and LLM Influence Measurement (LLM-IM), a regression task that quantifies the extent of LLM involvement in content creation. To support these tasks, we propose LLMDetect, a benchmark designed to evaluate detectors' performance on these new tasks. LLMDetect includes the Hybrid News Detection Corpus (HNDC) for training detectors, as well as DetectEval, a comprehensive evaluation suite that considers five distinct cross-context variations and two multi-intensity variations within the same LLM role. This allows for a thorough assessment of detectors' generalization and robustness across diverse contexts. Our empirical validation of 10 baseline detection methods demonstrates that fine-tuned PLM-based models consistently outperform others on both tasks, while advanced LLMs face challenges in accurately detecting their own generated content. Our experimental results and analysis offer insights for developing more effective detection models for LLM-generated content. This research enhances the understanding of LLM-generated content and establishes a foundation for more nuanced detection methodologies.

文本检测大模型角色识别影响力测量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。