提出行级融合正则化,实现大规模个性化联邦学习的可解释建模。
Row-wise Fusion Regularization: An Interpretable Personalized Federated Learning Framework in Large-Scale Scenarios
- 通过行级聚类与稀疏性约束,捕捉变量层面的共享结构。
- 在异构场景下,预测误差降低30%以上,变量聚类恢复准确率显著提升。
- 适合需要可解释性与隐私保护的医疗、金融等大规模联邦学习应用。
针对多变量响应的个性化联邦学习问题,现有逐元素惩罚忽略跨响应依赖,矩阵级融合又过度耦合客户端。本文提出稀疏行级融合(SROF)正则项,对跨客户端的行向量进行聚类并诱导行内稀疏性,并设计通信高效的RowFed算法,将其嵌入线性化ADMM框架,支持隐私保护的部分参与。理论上,证明SROF具有选择性一致性,可实现正确的变量级分组恢复且具有渐近正态性;并证明RowFed收敛至稳定解。在随机客户端参与下,迭代差距以参与概率提升的速度缩小。仿真显示,当客户端异构时,RowFed持续降低估计与预测误差,优于NonFed、FedAvg及个性化矩阵融合基线;真实数据研究进一步验证其优势并保持可解释性。结果表明,行级融合是大尺度个性化多变量联邦学习的有效且透明范式,弥合了逐元素与矩阵级方法之间的鸿沟。
原文摘要 · Abstract (English)
We study personalized federated learning for multivariate responses where client models are heterogeneous yet share variable-level structure. Existing entry-wise penalties ignore cross-response dependence, while matrix-wise fusion over-couples clients. We propose a Sparse Row-wise Fusion (SROF) regularizer that clusters row vectors across clients and induces within-row sparsity, and we develop RowFed, a communication-efficient federated algorithm that embeds SROF into a linearized ADMM framework with privacy-preserving partial participation. Theoretically, we establish an oracle property for SROF-achieving correct variable-level group recovery with asymptotic normality-and prove convergence of RowFed to a stationary solution. Under random client participation, the iterate gap contracts at a rate that improves with participation probability. Empirically, simulations in heterogeneous regimes show that RowFed consistently lowers estimation and prediction error and strengthens variable-level cluster recovery over NonFed, FedAvg, and a personalized matrix-fusion baseline. A real-data study further corroborates these gains while preserving interpretability. Together, our results position row-wise fusion as an effective and transparent paradigm for large-scale personalized federated multivariate learning, bridging the gap between entry-wise and matrix-wise formulations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。