通过视觉提示修正异构数据分布,实现零计算开销的一次性联邦学习。
FedOPAL: One-Shot Federated Learning via Analytic Visual Prompt Tuning

- 用视觉提示作为特征校正器,通过局部约束使异构数据线性可分
- 在多个基准上超越传统解析方法,精度接近顶尖迭代方法
- 无需服务器训练,适合资源受限的边缘大模型协同场景
随着基础模型在边缘智能中的广泛应用,通信带宽已成为制约联邦学习可扩展性的核心瓶颈。尽管一次性联邦学习通过减少通信轮次缓解了该问题,但现有基于迭代微调或知识蒸馏的方法仍面临服务器端计算成本高和超参数敏感等问题。解析联邦学习利用最小二乘闭式解实现无梯度聚合,但在非独立同分布数据环境下,其静态特征假设失效,导致特征流形错位,严重损害模型性能。为此,本文提出FedOPAL框架,将视觉提示作为特征修正器,通过施加局部近端约束,主动将异构数据特征分布校正至线性可分空间,满足解析联邦学习的理论假设。实验表明,FedOPAL不仅显著优于原有解析方法,且在保持零服务器训练成本的同时,达到与最先进迭代方法相当的精度,为边缘大模型高效协作提供了新范式。
原文摘要 · Abstract (English)
With the widespread deployment of basic models in edge intelligence, communication bandwidth has become a core bottleneck restricting the scalability of federated learning. Although one-shot federated learning alleviates this problem by minimizing communication rounds, existing iterative fine-tuning or knowledge distillation methods still face challenges such as high server-side computational costs and hyperparameter sensitivity. Analytical federated learning achieves efficient gradientfree aggregation using least-squares closed-form solutions, but in environments with non-independent and identically distributed data, its static feature assumptions fail, leading to feature manifold misalignment and severely impairing model performance. To address this contradiction, this paper proposes the FedOPAL framework. This framework adapts the visual prompts as feature rectifiers, actively correcting the feature distribution of heterogeneous data to a linearly separable space by applying local proximal constraints, thereby satisfying the theoretical assumptions of analytical federated learning. Experimental results show that FedOPAL not only significantly outperforms the original analytical methods on several benchmarks, but also achieves accuracy comparable to state-of-the-art iterative methods while maintaining zero server-side training costs, providing a new engineering paradigm for efficient collaboration of large models on the edge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。