arXiv:2605.02169cs.CVcs.DC2026-05被引 1

用生成式方法实现多摄像头隐私保护目标检测,解决数据隐私与模型异构问题。

Heterogeneous Model Fusion for Privacy-Aware Multi-Camera Surveillance via Synthetic Domain Adaptation

论文配图:Heterogeneous Model Fusion for Privacy-Aware Multi-Camera Surveillance via Synthetic Domain Adaptation
图 1 · 摘自论文原文
  • 基于扩散模型生成目标图像,单图学习风格并可控生成稀有物体。
  • 联邦学习中提升定位精度,动态对比策略抑制域偏移,融合异构模型不传原始数据。
  • 解决标签不一致与架构差异,隐私保护下达到33.4% mAP新高,适合多摄像头监控场景。

我们提出HeroCrystal,一种新型隐私保护的多摄像头域适应目标检测框架,应对数据隐私、类别不平衡和异构架构等挑战。框架包含三个阶段:生成阶段引入一次性的、目标感知的扩散生成模块,仅需一张目标域图像即可学习视觉风格,并通过提示控制合成特定物体实例;相比传统风格迁移方法依赖大量目标数据且忽略语义差异,该方法实现隐私友好型增强,并可控生成罕见物体以缓解长尾类别退化。联邦阶段在客户端使用概率性Faster R-CNN提升定位精度,采用动态模型对比策略抑制域特异性偏差;服务端在不访问原始数据的前提下融合异构架构模型。最后,在蒸馏阶段提出不一致类别整合算法,解决客户端间标签不一致与架构异构问题。在多个跨域检测基准上的实验表明,该方法在多类、隐私保护设置下优于现有多源域适应与联邦学习基线,相比先前隐私保护方法提升2.1% mAP,达成33.4%的新最优mAP,验证了HeroCrystal在实际多摄像头智能监控系统中的有效性。源代码已公开于https://github.com/ccuvislab/HeroCrystal。

原文摘要 · Abstract (English)

We propose HeroCrystal, a novel privacy-preserving framework for multi-camera domain-adaptive object detection, addressing challenges such as data privacy, class imbalance, and heterogeneous architectures. Our framework consists of three key stages. In the Generated Stage, we introduce a one-shot, target-aware diffusion-based generation module that learns visual style from a single target-domain image while leveraging prompt-based control to synthesize specific object instances. Unlike conventional style transfer-based methods that require large target datasets and ignore semantic-level discrepancies, our approach enables privacy-preserving augmentation to reduce ethical concerns, and introduces controllable rare object generation to mitigate long-tailed category degradation. In the Federated Stage, we employ probabilistic Faster R-CNN on the client side to improve localization accuracy, and a dynamic model contrastive strategy to suppress domain-specific bias. The server side performs model fusion across heterogeneous architectures without accessing raw data. Finally, in the Distilled Stage, we propose an inconsistent categories integration algorithm to resolve label inconsistency and architecture heterogeneity across clients. Extensive experiments on multiple cross-domain detection benchmarks demonstrate that our method outperforms existing multi-source domain adaptation and federated learning baselines under multi-class, privacy-preserving settings. Our method improves mAP by +2.1% over prior privacy-preserving approaches and achieves a new state-of-the-art mAP of 33.4%, highlighting the effectiveness of HeroCrystal in enabling practical multi-camera AI surveillance systems. The source code is publicly available at https://github.com/ccuvislab/HeroCrystal.

多摄像头隐私保护域自适应联邦学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。