arXiv:2605.10748cs.LGcs.AI2026-05

通过稀疏反演与分块重标,提升单轮联邦学习生成数据质量。

Provable Sparse Inversion and Token Relabel Enhanced One-shot Federated Learning with ViTs

论文配图:Provable Sparse Inversion and Token Relabel Enhanced One-shot Federated Learning with ViTs
图 1 · 摘自论文原文
  • 仅反转图像语义前景,抑制无意义背景干扰。
  • 高信息密度块用伪标签,低信息块用集成模型重标。
  • 理论证明可降低梯度方差,适合极端非独立同分布场景。

单轮联邦学习在单次通信中训练全局模型,具有潜力。但在极端非独立同分布(non-IID)设置下,现有无数据方法常生成语义错位的低质量数据。为此,我们提出联邦模型反演与分块重标(FedMITR)框架,通过充分利用合成图像的所有图像块来训练全局模型。具体地,FedMITR在数据生成中采用稀疏模型反演,仅选择性地反演语义前景,停止对无信息背景的反演;为解决阻碍ViT预测的语义无关块,实施差异化策略:高信息密度块使用生成伪标签,低信息密度块通过集成模型进行重标以实现稳健蒸馏。理论上,基于算法稳定性的分析表明,稀疏模型反演可消除由背景噪声引发的梯度不稳定性,而分块重标有效降低梯度方差,共同保障更紧的泛化界。实验结果表明,FedMITR在多种设置下显著优于现有基线。

原文摘要 · Abstract (English)

One-Shot Federated Learning, where a central server learns a global model in a single communication round, has emerged as a promising paradigm. However, under extremely non-IID settings, existing data-free methods often generate low-quality data that suffers from severe semantic misalignment with ground-truth labels. To overcome these issues, we propose a novel Federated Model Inversion and Token Relabel (FedMITR) framework, which trains the global model by fully exploiting all patches of synthetic images. Specifically, FedMITR employs sparse model inversion during data generation, selectively inverting semantic foregrounds while halting the inversion of uninformative backgrounds. To address semantically meaningless tokens that hinder ViT predictions, we implement a differentiated strategy: patches with high information density utilize generated pseudo-labels, while patches with low information density are relabeled via ensemble models for robust distillation. Theoretically, our analysis based on algorithmic stability reveals that Sparse Model Inversion eliminates gradient instability arising from background noise, while Token Relabel effectively reduces gradient variance, collectively guaranteeing a tighter generalization bound. Empirically, extensive experimental results demonstrate that FedMITR substantially outperforms existing baselines under various settings.

联邦学习视觉变换器数据生成稀疏反演

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。