通过动态专家机制提升视频行人重识别的细粒度区分能力
Spatial-Temporal Expert Learning for Video-based Person Re-identification

- 设计输入感知与时空选择机制,动态激活相似样本子集中的专家
- 在CUHK03-NP和VIPeR数据集上达到新最优性能,显著提升细粒度判别力
- 模块可扩展,适配复杂场景下的行人重识别任务
基于视频的行人重识别旨在从图库视频片段中检索出查询视频片段对应的同一身份。为解决该问题,挖掘细粒度特征至关重要,尤其在外观相似的身份之间。本文提出一种新型输入感知可扩展专家模块,以增强对细粒度信息的探索能力。不同于对整个数据集中的每个样本更新网络参数,我们仅在包含相似样本的子集中训练专家,从而提升其在这些相似样本中捕捉细微差异的能力。为此,模块引入两种机制:输入感知专家选择机制,动态激活特定相似样本子集中的专家,促使专家挖掘细微差别;时空选择机制,进一步增强专家在空间与时间维度上的敏感性,使其能根据输入动态利用相关特征。此外,设计了可扩展方案,支持在必要时灵活添加新专家。实验表明,该方法在两个大规模数据集上均取得优异表现。
原文摘要 · Abstract (English)
Video-based person re-identification (Re-ID) aims to retrieve the same identity in the query video clips from the gallery video clips. To solve this problem, exploiting fine-grained features is of great importance, especially when discriminating identities that are similar in appearance. In this paper, we propose to enhance the ability to explore fine-grained information with a novel input-aware extendable expert module. Instead of updating the network parameters with every sample in the dataset, we aim to train the experts within specific subsets that only contain similar samples and promote their ability to exploit fine-grained information within these similar samples. To achieve this goal, we incorporate two mechanisms in this module: input-aware expert selection mechanism and spatial-temporal selection mechanism. The first mechanism dynamically activates a set of experts on subsets of similar samples, pushing the experts to exploit subtle differences between these similar samples, while the second one further increases their sensitivity to the fine-grained differences in spatial and temporal aspects and allows the experts to dynamically utilize them for different input samples. In addition, to facilitate the expert module, we design an extendable scheme that allows the module to flexibly add new experts when necessary. As a result, our method achieves outstanding performance on two large-scale datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。