提出隐私保护的跨模态行人重识别新基准,支持分布式训练。
L2RW+: A Comprehensive Benchmark Towards Privacy-Preserved Visible-Infrared Person Re-Identification
- 设计分级隐私协议,支持数据隔离与选择性共享的分布式训练
- 视频级任务下分布式训练性能逼近中心化方法,数据越多差距越小
- 适合关注真实场景部署与数据隐私的计算机视觉研究者
可见光-红外行人重识别(VI-ReID)旨在匹配不同光照条件下捕获的行人图像,虽已取得显著进展,但现有方法多采用集中式训练,忽视了真实场景中数据分散于多个设备或实体带来的隐私风险。本文提出L2RW+基准,将VI-ReID推向实际应用。核心思想是引入去中心化训练以应对数据共享受限的隐私挑战,设计了适用于不同隐私敏感度的训练协议与算法。基准模拟两种真实数据分布情形:1)每个摄像头数据完全隔离;2)不同数据主体(如区域数据控制方)可选择性共享。实验表明,去中心化训练在图像与视频级别均具备可行性;随着数据规模增加,分布式与集中式训练的性能差距缩小,尤其在视频级任务中更为明显。在未见领域上,去中心化训练性能可媲美当前最优的集中式方法。该工作为真实场景下部署VI-ReID提供了新路径,代码已开源。
原文摘要 · Abstract (English)
Visible-infrared person re-identification (VI-ReID) is a challenging task that aims to match pedestrian images captured under varying lighting conditions, which has drawn intensive research attention and achieved promising results. However, existing methods adopt the centralized training, ignoring the potential privacy concerns as the data is distributed across multiple devices or entities in reality. In this paper, we propose L2RW+, a benchmark that brings VI-ReID closer to real-world applications. The core rationale behind L2RW+ is that incorporating decentralized training into VI-ReID can address privacy concerns in scenarios with limited data-sharing constrains. Specifically, we design protocols and corresponding algorithms for different privacy sensitivity levels. In our new benchmark, we simulate the training under real-world data conditions that: 1) data from each camera is completely isolated, or 2) different data entities (e.g., data controllers of a certain region) can selectively share the data. In this way, we simulate scenarios with strict privacy restrictions, which is closer to real-world conditions. Comprehensive experiments show the feasibility and potential of decentralized VI-ReID training at both image and video levels. In particular, with increasing data scales, the performance gap between decentralized and centralized training decreases, especially in video-level VI-ReID. In unseen domains, decentralized training even achieves performance comparable to SOTA centralized methods. This work offers a novel research entry for deploying VI-ReID into real-world scenarios and can benefit the community. Code is available at: https://github.com/Joey623/L2RW.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。