6G边缘智能中,用隐私保护的自适应神经网络搜索提升模型性能。
DPFNAS: Differential Privacy-Enhanced Federated Neural Architecture Search for 6G Edge Intelligence
- 基于样本级表示与个性化差分隐私,防止数据重建攻击。
- 提出隐私感知的神经架构搜索,本地定制模型结构与超参。
- 在保证隐私前提下,精度提升6.82%,模型和通信成本大幅降低。
第六代(6G)网络将普适人工智能作为核心目标,依托设备端数据利用实现边缘智能。为达成此愿景,联邦学习(FL)成为边缘设备间协同训练的关键范式。然而,边缘数据的敏感性与异质性带来两大挑战:参数共享易引发数据重构风险,统一全局模型难以适应多样本地分布。本文提出一种新型联邦学习框架,融合个性化差分隐私(DP)与自适应模型设计。为保护训练数据,采用样本级表示进行知识共享,并应用个性化DP策略抵御重构攻击。为在隐私约束下实现分布感知适应,开发了隐私感知的神经架构搜索(NAS)算法,生成本地定制的模型架构与超参数。据我们所知,这是首个面向基于表示的联邦学习、具备理论收敛保障的个性化DP方案。实验表明,本方案在保持强隐私保障的同时,显著优于现有方法:在CIFAR-10与CIFAR-100等基准数据集上,相较联邦NAS方法PerFedRLNAS,准确率提升6.82%,模型规模缩减至1/10,通信开销降低至1/20。
原文摘要 · Abstract (English)
The Sixth-Generation (6G) network envisions pervasive artificial intelligence (AI) as a core goal, enabled by edge intelligence through on-device data utilization. To realize this vision, federated learning (FL) has emerged as a key paradigm for collaborative training across edge devices. However, the sensitivity and heterogeneity of edge data pose key challenges to FL: parameter sharing risks data reconstruction, and a unified global model struggles to adapt to diverse local distributions. In this paper, we propose a novel federated learning framework that integrates personalized differential privacy (DP) and adaptive model design. To protect training data, we leverage sample-level representations for knowledge sharing and apply a personalized DP strategy to resist reconstruction attacks. To ensure distribution-aware adaptation under privacy constraints, we develop a privacy-aware neural architecture search (NAS) algorithm that generates locally customized architectures and hyperparameters. To the best of our knowledge, this is the first personalized DP solution tailored for representation-based FL with theoretical convergence guarantees. Our scheme achieves strong privacy guarantees for training data while significantly outperforming state-of-the-art methods in model performance. Experiments on benchmark datasets such as CIFAR-10 and CIFAR-100 demonstrate that our scheme improves accuracy by 6.82\% over the federated NAS method PerFedRLNAS, while reducing model size to 1/10 and communication cost to 1/20.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。