用可微方法消除大模型对版权内容的复刻记忆,保护法律合规性。
SUV: Scalable Large Language Model Copyright Compliance with Regularized Selective Unlearning
- 通过构建侵权案例数据集,用直接偏好优化替换原文复制内容。
- 在500本知名书籍上测试,复现率显著下降,其他任务性能几乎不变。
- 适合关注模型法律风险、需高合规性的工业级LLM开发者使用。
大型语言模型(LLMs)虽凭借海量数据训练取得突破,但也因无意生成受版权保护内容而面临法律诉讼风险。本文提出SUV(Selective Unlearning for Verbatim data),一种选择性遗忘框架,旨在防止模型记忆版权内容的同时保持整体能力。该方法首先构建一个包含目标模型侵权实例的数据集;随后利用直接偏好优化(DPO)将原样复制的版权内容替换为合理且连贯的替代文本。为避免DPO对其他任务性能造成损害,引入梯度投影与费舍尔信息正则化进行缓解。在包含500本主要受版权保护书籍的大规模数据集上验证,SUV显著降低了原文复现率,同时对无关任务性能影响极小。在自建数据集及公开基准上的广泛实验进一步证明了该方法的可扩展性与有效性,为现实场景中降低大模型版权风险提供了可行方案。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have transformed natural language processing by learning from massive datasets, yet this rapid progress has also drawn legal scrutiny, as the ability to unintentionally generate copyrighted content has already prompted several prominent lawsuits. In this work, we introduce SUV (Selective Unlearning for Verbatim data), a selective unlearning framework designed to prevent LLM from memorizing copyrighted content while preserving its overall utility. In detail, the proposed method constructs a dataset that captures instances of copyrighted infringement cases by the targeted LLM. With the dataset, we unlearn the content from the LLM by means of Direct Preference Optimization (DPO), which replaces the verbatim copyrighted content with plausible and coherent alternatives. Since DPO may hinder the LLM's performance in other unrelated tasks, we integrate gradient projection and Fisher information regularization to mitigate the degradation. We validate our approach using a large-scale dataset of 500 famous books (predominantly copyrighted works) and demonstrate that SUV significantly reduces verbatim memorization with negligible impact on the performance on unrelated tasks. Extensive experiments on both our dataset and public benchmarks confirm the scalability and efficacy of our approach, offering a promising solution for mitigating copyright risks in real-world LLM applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。