跨语言识别文本是人写的还是大模型生成的,挑战重重。
Authorship Attribution in Multilingual Machine-Generated Texts
- 在18种语言上测试7个大模型和人类写作的作者归属方法
- 跨语言迁移效果差,不同语系间性能显著下降
- 现有方法难适应多语言场景,需更鲁棒的新方案
随着大语言模型(LLMs)达到类人水平的流畅度与连贯性,区分机器生成文本(MGT)与人工写作愈发困难。早期工作多聚焦于二分类检测,但如今多样化的模型生态要求更精细的作者归属(AA)——即精准识别文本来源(特定大模型或人类)。然而,当前研究仍局限于单语环境,以英语为主,忽视了现代大模型的多语言特性。本文首次提出多语言作者归属问题,覆盖18种语言(涵盖多个语系与书写系统)及8类生成器(7个大模型+人类)。我们评估了单语作者归属方法在跨语言场景下的迁移能力及其对性能的影响。结果表明,尽管部分方法可适配多语言环境,但在不同语系间迁移仍存在显著局限,凸显多语言作者归属的复杂性,亟需更鲁棒的方法以贴近真实应用场景。
原文摘要 · Abstract (English)
As Large Language Models (LLMs) have reached human-like fluency and coherence, distinguishing machine-generated text (MGT) from human-written content becomes increasingly difficult. While early efforts in MGT detection have focused on binary classification, the growing landscape and diversity of LLMs require a more fine-grained yet challenging authorship attribution (AA), i.e., being able to identify the precise generator (LLM or human) behind a text. However, AA remains nowadays confined to a monolingual setting, with English being the most investigated one, overlooking the multilingual nature and usage of modern LLMs. In this work, we introduce the problem of Multilingual Authorship Attribution, which involves attributing texts to human or multiple LLM generators across diverse languages. Focusing on 18 languages -- covering multiple families and writing scripts -- and 8 generators (7 LLMs and the human-authored class), we investigate the multilingual suitability of monolingual AA methods in terms of their cross-lingual transferability, and the impact of generators on attribution performance. Our results reveal that while certain monolingual AA methods can be adapted to multilingual settings, significant limitations and challenges remain, particularly in transferring across diverse language families, underscoring the complexity of multilingual AA and the need for more robust approaches to better match real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。