arXiv:2409.18245eess.IV2024-09中稿 · SIGGRAPH被引 1

用区块链实现去中心化扩散模型训练,保护创作隐私并激励贡献者。

PDFed: Privacy-Preserving and Decentralized Asynchronous Federated Learning for Diffusion Models

  • 基于样本的新颖性评分,结合区块链实现无中心化异步联邦学习。
  • 有效降低模型对私有数据的记忆,提升生成图像的隐私安全性。
  • 适合关注艺术版权、去中心化AI协作的创作者与开发者。

我们提出PDFed,一种用于图像扩散模型训练的去中心化、无聚合器、异步联邦学习协议,基于公共区块链实现。扩散模型易记忆训练数据,引发隐私与伦理问题(如生成图像泄露私有数据)。联邦学习通过分布式节点协作训练,在保护本地数据隐私方面提供部分解决方案。PDFed引入一种基于样本的新颖性与质量评分机制,将其整合进基于区块链的联邦学习协议中,实证表明该方法可显著减少协同训练模型对私有数据的记忆。此外,协议支持硬件能力各异参与者的异步协作,促进更广泛参与。协议记录模型来源,增强透明性与可审计性,并设计自动化激励与奖励机制。PDFed旨在保护创作者作品隐私,推动艺术家与创作者在去中心化、点对点协作中获益,为创意经济开辟新收入渠道,创新创作者价值回馈方式。

原文摘要 · Abstract (English)

We present PDFed, a decentralized, aggregator-free, and asynchronous federated learning protocol for training image diffusion models using a public blockchain. In general, diffusion models are prone to memorization of training data, raising privacy and ethical concerns (e.g., regurgitation of private training data in generated images). Federated learning (FL) offers a partial solution via collaborative model training across distributed nodes that safeguard local data privacy. PDFed proposes a novel sample-based score that measures the novelty and quality of generated samples, incorporating these into a blockchain-based federated learning protocol that we show reduces private data memorization in the collaboratively trained model. In addition, PDFed enables asynchronous collaboration among participants with varying hardware capabilities, facilitating broader participation. The protocol records the provenance of AI models, improving transparency and auditability, while also considering automated incentive and reward mechanisms for participants. PDFed aims to empower artists and creators by protecting the privacy of creative works and enabling decentralized, peer-to-peer collaboration. The protocol positively impacts the creative economy by opening up novel revenue streams and fostering innovative ways for artists to benefit from their contributions to the AI space.

联邦学习扩散模型区块链隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。