用费舍尔信息优化量子联邦学习,提升模型性能与隐私保护。
Enhancing Quantum Federated Learning with Fisher Information-Based Optimization
- 基于本地模型的费舍尔信息筛选关键参数,减少无效通信。
- 在ADNI和MNIST数据集上,相比传统方法提升性能与鲁棒性。
- 适合关注量子机器学习与隐私保护的研究者参考。
联邦学习(FL)在多个领域日益流行,使客户端可在不共享敏感数据的情况下协同训练全局模型。然而,其多轮通信带来高成本、数据异构、处理时间长及隐私风险等问题。近年来,联邦学习与参数化量子电路的结合引发广泛关注,尤其在医疗和金融领域具有潜力。通过实现量子模型的去中心化训练,各客户端可协作提升模型表现并保护数据隐私。鉴于费舍尔信息能量化量子态对参数变化的信息承载能力,反映其几何与统计特性,本文提出一种量子联邦学习(QFL)算法,利用本地客户端模型计算的费舍尔信息,针对异构数据分区进行优化。该方法识别显著影响模型性能的关键参数,并在聚合过程中加以保留。通过与多种变体对比,实验验证了该方法在ADNI和MNIST数据集上的有效性与可行性,表明其在性能和对抗量子联邦平均法方面更具优势。
原文摘要 · Abstract (English)
Federated Learning (FL) has become increasingly popular across different sectors, offering a way for clients to work together to train a global model without sharing sensitive data. It involves multiple rounds of communication between the global model and participating clients, which introduces several challenges like high communication costs, heterogeneous client data, prolonged processing times, and increased vulnerability to privacy threats. In recent years, the convergence of federated learning and parameterized quantum circuits has sparked significant research interest, with promising implications for fields such as healthcare and finance. By enabling decentralized training of quantum models, it allows clients or institutions to collaboratively enhance model performance and outcomes while preserving data privacy. Recognizing that Fisher information can quantify the amount of information that a quantum state carries under parameter changes, thereby providing insight into its geometric and statistical properties. We intend to leverage this property to address the aforementioned challenges. In this work, we propose a Quantum Federated Learning (QFL) algorithm that makes use of the Fisher information computed on local client models, with data distributed across heterogeneous partitions. This approach identifies the critical parameters that significantly influence the quantum model's performance, ensuring they are preserved during the aggregation process. Our research assessed the effectiveness and feasibility of QFL by comparing its performance against other variants, and exploring the benefits of incorporating Fisher information in QFL settings. Experimental results on ADNI and MNIST datasets demonstrate the effectiveness of our approach in achieving better performance and robustness against the quantum federated averaging method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。