arXiv:2507.10160cs.LGcs.CR2025-07

让边缘设备在数据少、环境变时,也能高效适应新领域。

Domain Borders Are There to Be Crossed With Federated Few-Shot Adaptation

  • 用冻结主干的轻量适配层,在资源受限设备上完成领域自适应。
  • 仅需少量目标样本即实现与主流方法相当的性能提升。
  • 适合工业场景中设备频繁更换、数据不稳定的实时部署需求。

联邦学习已成为去中心化、隐私保护学习的主流范式,尤其适用于配备传感器的互联边缘设备。然而其实际应用面临三大挑战:目标域适应需人工参与昂贵的数据标注;因环境因素导致客户端数据采集出现协变量偏移,使源域与目标域样本存在差异;在资源受限环境下,连续或定期更新模型不切实际,受限于数据传输能力及信道可用性与能效的技术约束。为应对这些问题,我们扩展了一个面向工业场景真实客户端适配的高效可扩展联邦学习框架。该框架基于预训练的源模型,包含深度主干、适配模块和分类器,均部署在强大服务器端。客户端适配时冻结主干和分类器,仅通过领域自适应线性层完成目标域迁移,显著降低整体计算开销。此架构称为FedAcross+,并进一步支持流式数据处理,使其适用于非平稳环境。大量实验表明,FedAcross+可在低端客户端设备上以极少量目标样本实现具有竞争力的适应性能,有效应对领域偏移问题。此外,该框架支持在资源受限环境中间歇性模型更新,确保实际且无缝部署。

原文摘要 · Abstract (English)

Federated Learning has emerged as a leading paradigm for decentralized, privacy-preserving learning, particularly relevant in the era of interconnected edge devices equipped with sensors. However, the practical implementation of Federated Learning faces three primary challenges: the need for human involvement in costly data labelling processes for target adaptation, covariate shift in client device data collection due to environmental factors affecting sensors, leading to discrepancies between source and target samples, and the impracticality of continuous or regular model updates in resource-constrained environments due to limited data transmission capabilities and technical constraints on channel availability and energy efficiency. To tackle these issues, we expand upon an efficient and scalable Federated Learning framework tailored for real-world client adaptation in industrial settings. This framework leverages a pre-trained source model comprising a deep backbone, an adaptation module, and a classifier running on a powerful server. By freezing the backbone and classifier during client adaptation on resource-constrained devices, we allow the domain adaptive linear layer to handle target domain adaptation, thus minimizing overall computational overhead. Furthermore, this setup, designated as FedAcross+, is extended to encompass the processing of streaming data, thereby rendering the solution suitable for non-stationary environments. Extensive experimental results demonstrate the effectiveness of FedAcross+ in achieving competitive adaptation on low-end client devices with limited target samples, successfully addressing the challenge of domain shift. Moreover, our framework accommodates sporadic model updates within resource-constrained environments, ensuring practical and seamless deployment.

联邦学习少样本适应边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。