arXiv:2412.06619cs.LGcs.CL2024-12ICLR被引 7

通过自适应融合模型降低生成内容抄袭风险,兼顾质量与效率。

Copyright-Protected Language Generation via Adaptive Model Fusion

  • 推理时融合多个训练数据不重叠的模型,动态调整输出以减少版权内容重现
  • 实验显示生成文本和代码中受保护内容重现率显著下降,且质量不受损
  • 可无缝对接其他防护措施,适合需版权合规的生成系统部署

语言模型在训练过程中可能复制受版权保护的内容,为此已有多种防护手段。其中,推理阶段通过后处理施加约束的方法虽具潜力,但常伴随高昂计算成本或性能折损。为此,本文提出版权保护型模型融合(CP-Fuse),在推理时结合多个训练数据无重叠的模型输出,并自适应聚合以最小化版权内容再现,同时保持关键平衡性,防止记忆数据的直接复现。大量实验证明,CP-Fuse能显著降低受保护内容的重现率,且不影响文本与代码生成质量。其后置特性支持与其他防护机制集成,进一步强化版权保护。此外,该方法对常见训练数据提取技术具有鲁棒性。

原文摘要 · Abstract (English)

The risk of language models reproducing copyrighted material from their training data has led to the development of various protective measures. Among these, inference-time strategies that impose constraints via post-processing have shown promise in addressing the complexities of copyright regulation. However, they often incur prohibitive computational costs or suffer from performance trade-offs. To overcome these limitations, we introduce Copyright-Protecting Model Fusion (CP-Fuse), a novel approach that combines models trained on disjoint sets of copyrighted material during inference. In particular, CP-Fuse adaptively aggregates the model outputs to minimize the reproduction of copyrighted content, adhering to a crucial balancing property that prevents the regurgitation of memorized data. Through extensive experiments, we show that CP-Fuse significantly reduces the reproduction of protected material without compromising the quality of text and code generation. Moreover, its post-hoc nature allows seamless integration with other protective measures, further enhancing copyright safeguards. Lastly, we show that CP-Fuse is robust against common techniques for extracting training data.

版权保护模型融合生成安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。