提出可解释的风格解耦模型,提升文本作者归属与生成内容检测的泛化能力。
Explainable Disentangled Representation Learning for Generalizable Authorship Attribution in the Era of Generative AI

- 通过分离架构显式解耦写作风格与内容,避免主题干扰
- 在多个数据集上达到作者归属任务最优性能,少样本生成文本检测表现优异
- 兼具决策解释生成能力,适合需要可解释性的安全应用
学习鲁棒的作者风格表征对作者归属和生成文本检测至关重要。然而现有方法常受内容-风格纠缠影响,模型会学习作者风格与主题之间的虚假关联,导致跨领域泛化能力差。为此,我们提出可解释作者变分自编码器(EAVAE),通过设计上的结构分离实现风格与内容的显式解耦。EAVAE首先在多样化的作者数据上使用监督对比学习预训练风格编码器,随后采用变分自编码器架构,分别用独立编码器学习风格与内容表征。通过新颖的判别器强制解耦:该判别器不仅能判断风格/内容表示对是否来自同一作者或内容源,还能生成自然语言解释其判断依据,同时抑制混杂信息并增强可解释性。大量实验表明EAVAE有效:在作者归属任务中,在Amazon Reviews、PAN21和HRS等多个数据集上达到当前最优性能;在生成文本检测中,于M4数据集上展现出卓越的少样本学习能力。代码与数据仓库已公开。
原文摘要 · Abstract (English)
Learning robust representations of authorial style is crucial for authorship attribution and AI-generated text detection. However, existing methods often struggle with content-style entanglement, where models learn spurious correlations between authors' writing styles and topics, leading to poor generalization across domains. To address this challenge, we propose Explainable Authorship Variational Autoencoder (EAVAE), a novel framework that explicitly disentangles style from content through architectural separation-by-design. EAVAE first pretrains style encoders using supervised contrastive learning on diverse authorship data, then finetunes with a Variational Autoencoder (VEA) architecture using separate encoders for style and content representations. Disentanglement is enforced through a novel discriminator that not only distinguishes whether pairs of style/content representations belong to the same or different authors/content sources, but also generates natural language explanation for their decision, simultaneously mitigating confounding information and enhancing interpretability. Extensive experiments demonstrate the effectiveness of EAVAE. On authorship attribution, we achieve state-of-the-art performance on various datasets, including Amazon Reviews, PAN21, and HRS. For AI-generated text detection, EAVAE excels in few-shot learning over the M4 dataset. Code and data repositories are available online\footnote{https://github.com/hieum98/avae} \footnote{https://huggingface.co/collections/Hieuman/document-level-authorship-datasets}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。