arXiv:2512.07208cs.LGcs.AI2025-12被引 1

用几何先验纠正联邦提示学习中的局部偏差,提升模型泛化能力。

Geometric Prior-Guided Federated Prompt Calibration

  • 通过全局数据分布的几何先验,引导客户端修正本地特征分布偏移。
  • 在极端数据偏斜下(β=0.01),性能比基线提升9.17%。
  • 可作为插件模块适配多种联邦学习框架,适合处理非独立同分布数据。

联邦提示学习(FPL)为协同训练大模型提供了一种参数高效方案,但其性能受数据异质性严重制约,导致本地训练的提示产生偏差。现有方法聚焦于聚合或正则化,未能解决本地训练偏差的根本原因。为此,我们提出几何先验引导的文本提示校准(GGTPC),通过在服务器上隐私保护地重构全局数据分布的协方差矩阵以获得全局几何先验,并由客户端使用新型几何先验校准层(GPCL)在训练中对齐本地特征分布与该先验。大量实验表明,该方法有效。在标签偏斜的CIFAR-100数据集(β=0.1)上,优于当前最优方法2.15%;在极端偏斜(β=0.01)下,性能提升9.17%;在领域偏斜的Office-Home数据集上,作为插件模块使FedAvg性能提升4.60%。结果证明,GGTPC通过纠正根本性的局部训练偏差,有效缓解数据异质性,可广泛增强各类联邦学习算法。

原文摘要 · Abstract (English)

Federated Prompt Learning (FPL) offers a parameter-efficient solution for collaboratively training large models, but its performance is severely hindered by data heterogeneity, which causes locally trained prompts to become biased. Existing methods, focusing on aggregation or regularization, fail to address this root cause of local training bias. To this end, we propose Geometry-Guided Text Prompt Calibration (GGTPC), a novel framework that directly corrects this bias by providing clients with a global geometric prior. This prior, representing the shape of the global data distribution derived from the covariance matrix, is reconstructed on the server in a privacy-preserving manner. Clients then use a novel Geometry-Prior Calibration Layer (GPCL) to align their local feature distributions with this global prior during training. Extensive experiments show GGTPC's effectiveness. On the label-skewed CIFAR-100 dataset ($β$=0.1), it outperforms the state-of-the-art by 2.15\%. Under extreme skew ($β$=0.01), it improves upon the baseline by 9.17\%. Furthermore, as a plug-and-play module on the domain-skewed Office-Home dataset, it boosts FedAvg's performance by 4.60\%. These results demonstrate that GGTPC effectively mitigates data heterogeneity by correcting the fundamental local training bias, serving as a versatile module to enhance various FL algorithms.

联邦学习提示学习数据异质性几何先验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。