针对非独立同分布数据,提出基于最优传输的联邦提示调优方法
D-FROST: Decentralized Federated pRompt-tuning via Optimal tranSporT for Non-IID and Imbalanced Data

- 用最优传输思想对齐各客户端的提示集,解决异构数据下的提示不匹配问题
- 理论证明算法能收敛到近似最优解,且客户端间提示集一致性误差有界
- 适合资源受限、数据异构的分布式场景,尤其适用于大模型轻量化适配
提示调优通过仅更新少量可学习提示来高效适配基础模型,无需微调预训练主干网络,特别适合去中心化联邦学习(DFL)场景。然而,在DFL中,各客户端从异构本地数据中学得的提示集往往无法一一对应,导致标准平均聚合失效。同时,算法需保证收敛性与共识达成。本文首次研究了在去中心化联邦学习中进行提示调优的问题,将该问题建模为基于沃尔什斯坦距离的提示分布优化问题,捕捉提示集的集合结构特征。为此,我们提出D-FROST:一种基于最优传输的去中心化提示调优算法,通过运输匹配将邻近客户端的提示集合并为紧凑的代表性提示集。进一步分析表明,客户端间的沃尔什斯坦共识误差被有效控制,网络层面的提示巴氏中心收敛至驻点附近。在异构客户端数据下实验验证了D-FROST的有效性。
原文摘要 · Abstract (English)
Prompt tuning provides a parameter-efficient way to adapt foundation models (FMs) by freezing the pretrained backbone and updating only a small set of learnable prompts. This property makes prompt tuning especially suitable for decentralized federated learning (DFL), where exchanging full-model updates can be prohibitively expensive. However, prompt tuning in DFL introduces new challenges. Prompt sets learned from heterogeneous local data may not be index-wise aligned, making standard decentralized averaging unsuitable. In addition, the algorithm should be theoretically guaranteed to achieve consensus and make progress toward the shared objective. In this work, we provide the first study of prompt tuning in DFL. We formulate decentralized prompt tuning as a Wasserstein-based optimization problem over prompt measures, which captures the set-valued structure of prompts. We then propose D-FROST, an optimal-transport-based (OT-based) decentralized prompt-tuning algorithm that merges neighborhood prompts into compact representative prompt sets through transportation-based matching. We further analyze D-FROST by bounding the Wasserstein consensus error across clients, and establishing convergence of the network-level prompt barycenter to a neighborhood of stationarity. Experiments under heterogeneous client data demonstrate the effectiveness of D-FROST for decentralized prompt tuning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。