arXiv:2506.02964cs.CVcs.LG2025-06NeurIPS被引 3

用无监督槽注意力实现跨域联邦对象级表征学习

FORLA: Federated Object-centric Representation Learning with Slot Attention

  • 通过共享槽注意力模块与双分支师生架构,联合优化跨客户端特征
  • 在真实数据集上实现比中心化基线更好的物体发现效果,且表征更紧凑通用
  • 适合需要隐私保护的跨域视觉表征学习场景

在异构无标签数据集上学习高效的联邦视觉表征仍是核心挑战。有效的联邦表征需在客户端间保持联合信息性,同时无监督地解耦领域特异性因素。我们提出 FORLA,一种基于无监督槽注意力的联邦对象级表征学习与特征适配框架。核心包括:跨客户端协同训练的共享特征适配器,以及用于重建适配特征的共享槽注意力模块。为优化适配器,设计双分支师生架构:每个客户端中,学生解码器从基础模型全维特征重建,教师解码器从低维适配特征重建。共享槽注意力模块通过对齐客户端间对象级表征实现跨域学习。多个真实数据集实验表明,该框架不仅在物体发现任务上超越中心化基线,还学习到紧凑且跨域泛化能力强的通用表征。本工作凸显了联邦槽注意力在可扩展、无监督跨域视觉表征学习中的有效性。

原文摘要 · Abstract (English)

Learning efficient visual representations across heterogeneous unlabeled datasets remains a central challenge in federated learning. Effective federated representations require features that are jointly informative across clients while disentangling domain-specific factors without supervision. We introduce FORLA, a novel framework for federated object-centric representation learning and feature adaptation across clients using unsupervised slot attention. At the core of our method is a shared feature adapter, trained collaboratively across clients to adapt features from foundation models, and a shared slot attention module that learns to reconstruct the adapted features. To optimize this adapter, we design a two-branch student-teacher architecture. In each client, a student decoder learns to reconstruct full features from foundation models, while a teacher decoder reconstructs their adapted, low-dimensional counterpart. The shared slot attention module bridges cross-domain learning by aligning object-level representations across clients. Experiments in multiple real-world datasets show that our framework not only outperforms centralized baselines on object discovery but also learns a compact, universal representation that generalizes well across domains. This work highlights federated slot attention as an effective tool for scalable, unsupervised visual representation learning from cross-domain data with distributed concepts.

联邦学习对象级表征槽注意力无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。