arXiv:2603.12912cs.CVcs.AI2026-03

用可学习提示引导视觉注意力,提升跨客户端行人重识别的泛化能力。

FedBPrompt: Federated Domain Generalization Person Re-Identification via Body Distribution Aware Visual Prompts

  • 通过身体分布感知提示机制,让Transformer聚焦行人区域,抑制背景干扰。
  • 仅需少数通信轮次即实现显著性能提升,通信开销降低超80%。
  • 适配现有ViT框架,适合隐私保护下的分布式行人识别场景。

联邦域泛化行人重识别(FedDG-ReID)从分散数据中学习域不变表征。尽管视觉变压器(ViT)广泛应用,其全局注意力常难以区分与背景高度相似的行人或不同视角下的个体,这一问题在联邦环境中因客户端间分布差异而加剧。为此,我们提出联邦身体分布感知视觉提示(FedBPrompt),引入可学习的视觉提示,引导Transformer注意力聚焦于行人中心区域。该方法包含:整体全身提示以抑制跨客户端背景噪声,以及部位对齐提示以捕捉鲁棒于姿态和视角变化的细粒度特征。为降低通信开销,设计基于提示的微调策略(PFTS),冻结ViT主干网络,仅更新轻量级提示,大幅减少通信量同时保持适应性。大量实验表明,BAPM有效增强特征区分力与跨域泛化能力,PFTS在仅数轮聚合后即取得显著性能提升。二者均可无缝集成至现有基于ViT的FedDG-ReID框架,使FedBPrompt成为灵活高效的联邦行人重识别方案。代码已开源:https://github.com/leavlong/FedBPrompt。

原文摘要 · Abstract (English)

Federated Domain Generalization for Person Re-Identification (FedDG-ReID) learns domain-invariant representations from decentralized data. While Vision Transformer (ViT) is widely adopted, its global attention often fails to distinguish pedestrians from high similarity backgrounds or diverse viewpoints -- a challenge amplified by cross-client distribution shifts in FedDG-ReID. To address this, we propose Federated Body Distribution Aware Visual Prompt (FedBPrompt), introducing learnable visual prompts to guide Transformer attention toward pedestrian-centric regions. FedBPrompt employs a Body Distribution Aware Visual Prompts Mechanism (BAPM) comprising: Holistic Full Body Prompts to suppress cross-client background noise, and Body Part Alignment Prompts to capture fine-grained details robust to pose and viewpoint variations. To mitigate high communication costs, we design a Prompt-based Fine-Tuning Strategy (PFTS) that freezes the ViT backbone and updates only lightweight prompts, significantly reducing communication overhead while maintaining adaptability. Extensive experiments demonstrate that BAPM effectively enhances feature discrimination and cross-domain generalization, while PFTS achieves notable performance gains within only a few aggregation rounds. Moreover, both BAPM and PFTS can be easily integrated into existing ViT-based FedDG-ReID frameworks, making FedBPrompt a flexible and effective solution for federated person re-identification. The code is available at https://github.com/leavlong/FedBPrompt.

联邦学习行人重识别视觉提示ViT

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。