arXiv:2605.15518cs.CL2026-05ACL被引 1

构建多语言真实文本检测基准,评估大模型生成内容的识别能力。

DetectRL-X: Towards Reliable Multilingual and Real-World LLM-Generated Text Detection

  • 设计跨8种语言的综合评测基准,覆盖商业常用语种。
  • 引入4类商用大模型及润色等真实写作操作,模拟实际使用场景。
  • 支持多语言改写与干扰攻击,适合评估多语言检测器鲁棒性。

由于大语言模型(LLM)生成内容滥用风险加剧,其有效检测与治理变得日益重要。尽管现有检测器表现优异,但在多语言和真实场景下的可靠性仍缺乏充分探索。本文提出DetectRL-X,一个涵盖8个商业常用语言、6个高风险领域的多语言评测基准,用于评估先进检测器在8个维度上的性能。我们使用4种主流商用大模型生成文本,并加入润色、扩展、压缩等典型AI辅助写作操作,以还原真实使用模式。此外,构建了多语言改写与扰动攻击框架,模拟多样化的人类修改与写作噪声,实现对检测器的全面压力测试。实验表明,当前顶尖检测器在不同语言、领域、生成器及处理操作下表现差异显著。本研究揭示了文本长度、领域、生成器类型、攻击策略和精炼操作对检测性能的影响,证实DetectRL-X是提升多语言与语言特定检测器能力的有效工具。

原文摘要 · Abstract (English)

The effective detection and governance of Large Language Model (LLM) generated content has become increasingly critical due to the growing risk of misuse. Despite the impressive performance of existing detectors, their reliability and potential in multilingual, real-world scenarios remain largely underexplored. In this study, we introduce DetectRL-X, a comprehensive multilingual benchmark designed to evaluate advanced detectors across 8 dimensions. The benchmark encompasses 8 languages commonly used in commercial contexts and collects human-written texts from 6 domains highly susceptible to LLM misuse. To better aligned with real-world applications, We create LLM-generated texts using 4 popular commercial LLMs, and include typical AI-assisted writing operations such as polishing, expanding, and condensing to capture authentic usage patterns. Furthermore, we develop a multilingual framework for paraphrasing and perturbation attacks to simulate diverse human modifications and writing noise, enabling stress testing of detectors across languages. Experimental results on DetectRL-X reveal the strengths and limitations of current state-of-the-art detectors when applied to diverse linguistic resources. We further analyze how domains, generators, attack strategies, text length, and refinement operations influence performance in different languages, underscoring DetectRL-X as an effective benchmark for strengthening multilingual and language-specific detectors.

文本检测多语言大模型安全真实场景

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。