构建首个基于图的联邦学习数据集ModelNet,支持多场景隐私保护评估。
Towards Graph-Based Privacy-Preserving Federated Learning: ModelNet -- A ResNet-based Model Classification Dataset
- 从ResNet50提取特征,生成三类客户端专属图像数据集
- 在非独立同分布设置下验证算法性能,提升隐私保护有效性
- 适合研究联邦学习隐私机制与图驱动算法的研究者使用
联邦学习(FL)已成为在分布式数据源上训练模型的同时保持数据本地性的强大范式。然而,本地数据隐私始终是核心关切,近年来备受关注。此外,现有基准缺乏领域异质性和客户端特异性,制约了严格评估。本文提出ModelNet,一个基于预训练ResNet50模型嵌入构建的图像分类数据集。首先将CIFAR100改造成三种客户端专属变体,涵盖同质、异质和随机三种领域异质性。随后在预训练ResNet50上对每类变体训练,以保存模型参数。除多领域图像数据外,提出新假设:允许访问匿名化模型参数的联邦算法可更有效保护本地隐私。ModelNet通过引入非独立同分布数据分布与客户端多样性设计原则,模拟真实联邦学习场景,适用于传统与未来图驱动算法。三个变体分别为ModelNet-S(同质)、ModelNet-D(异质)、ModelNet-R(随机)。据我们所知,这是首个跨环境客户端专属的图基联邦学习数据集。基于域偏移与聚合策略的大量实验验证其有效性,为经典与图基联邦学习研究提供实用基准。数据集及代码已公开。
原文摘要 · Abstract (English)
Federated Learning (FL) has emerged as a powerful paradigm for training machine learning models across distributed data sources while preserving data locality. However, the privacy of local data is always a pivotal concern and has received a lot of attention in recent research on the FL regime. Moreover, the lack of domain heterogeneity and client-specific segregation in the benchmarks remains a critical bottleneck for rigorous evaluation. In this paper, we introduce ModelNet, a novel image classification dataset constructed from the embeddings extracted from a pre-trained ResNet50 model. First, we modify the CIFAR100 dataset into three client-specific variants, considering three domain heterogeneities (homogeneous, heterogeneous, and random). Subsequently, we train each client-specific subset of all three variants on the pre-trained ResNet50 model to save model parameters. In addition to multi-domain image data, we propose a new hypothesis to define the FL algorithm that can access the anonymized model parameters to preserve the local privacy in a more effective manner compared to existing ones. ModelNet is designed to simulate realistic FL settings by incorporating non-IID data distributions and client diversity design principles in the mainframe for both conventional and futuristic graph-driven FL algorithms. The three variants are ModelNet-S, ModelNet-D, and ModelNet-R, which are based on homogeneous, heterogeneous, and random data settings, respectively. To the best of our knowledge, we are the first to propose a cross-environment client-specific FL dataset along with the graph-based variant. Extensive experiments based on domain shifts and aggregation strategies show the effectiveness of the above variants, making it a practical benchmark for classical and graph-based FL research. The dataset and related code are available online.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。