联邦学习中实现高效持续测试时自适应,保护隐私且无需额外训练。
FedCTTA: A Collaborative Approach to Continual Test-Time Adaptation in Federated Learning
- 通过噪声样本输出分布相似性聚合,避免特征直接共享。
- 每轮自适应熵最小化,提升模型对分布变化的置信度。
- 无需服务器训练,内存恒定,适合大规模客户端场景。
联邦学习(FL)可在不共享原始数据的情况下实现跨分布式客户端的协作训练,适用于隐私敏感场景。然而,由于训练与部署阶段的数据分布差异,FL模型常出现性能下降。测试时自适应(TTA)通过仅使用测试样本使模型动态调整,提供有效解决方案。但现有联邦环境下的TTA方法面临计算开销大、特征共享引发隐私风险及内存限制导致扩展性差等问题。为此,本文提出联邦持续测试时自适应(FedCTTA),一种兼顾隐私与计算效率的联邦自适应框架。不同于依赖本地特征统计共享的方法,FedCTTA基于随机噪声样本上的模型输出分布,采用相似性感知聚合策略,在不交换原始特征的前提下实现知识共享。同时,通过在各客户端最小化熵以支持持续适应,增强模型对演化目标分布的信心。本方法无需服务器端自适应训练,且内存占用恒定,可随客户端数量或训练轮次增加而扩展。大量实验表明,FedCTTA在多种时空异构场景下均优于现有方法。
原文摘要 · Abstract (English)
Federated Learning (FL) enables collaborative model training across distributed clients without sharing raw data, making it ideal for privacy-sensitive applications. However, FL models often suffer performance degradation due to distribution shifts between training and deployment. Test-Time Adaptation (TTA) offers a promising solution by allowing models to adapt using only test samples. However, existing TTA methods in FL face challenges such as computational overhead, privacy risks from feature sharing, and scalability concerns due to memory constraints. To address these limitations, we propose Federated Continual Test-Time Adaptation (FedCTTA), a privacy-preserving and computationally efficient framework for federated adaptation. Unlike prior methods that rely on sharing local feature statistics, FedCTTA avoids direct feature exchange by leveraging similarity-aware aggregation based on model output distributions over randomly generated noise samples. This approach ensures adaptive knowledge sharing while preserving data privacy. Furthermore, FedCTTA minimizes the entropy at each client for continual adaptation, enhancing the model's confidence in evolving target distributions. Our method eliminates the need for server-side training during adaptation and maintains a constant memory footprint, making it scalable even as the number of clients or training rounds increases. Extensive experiments show that FedCTTA surpasses existing methods across diverse temporal and spatial heterogeneity scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。