针对伊斯兰服饰场景的行人重识别新数据集,解决现有模型在文化差异下的泛化难题。
A Culturally-Aware Benchmark for Person Re-Identification in Modest Attire
- 构建伊朗本土真实场景下的遮蔽式着装行人数据集
- 主流模型在该数据集上mAP下降超20%,凸显文化差异挑战
- 适合关注公平性、跨文化鲁棒性的计算机视觉研究者
行人重识别(ReID)是计算机视觉的关键任务,广泛应用于监控与安防。尽管近年取得进展,现有模型在跨文化场景中泛化能力仍弱,尤其在伊朗等伊斯兰地区,其普遍的遮蔽式着装导致特征不显著。现有数据集多聚焦欧美及东亚时尚,难以适配此类环境。为此,我们提出伊朗科技大学行人重识别数据集(IUST_PersonReId),涵盖市场、校园、清真寺等伊朗真实场景,强调遮蔽着装与多样背景。在SOLIDER与CLIP-ReID等先进模型上测试显示,相比Market1501和MSMT17,mAP分别下降50.75%、23.01%与38.09%、21.74%,凸显遮挡与特征稀疏的挑战。基于序列的评估表明,引入时间上下文可提升性能,验证了该数据集对发展文化敏感型、鲁棒性强的ReID系统的重要价值。IUST_PersonReId为全球范围内推动ReID研究的公平性与去偏提供了关键资源。
原文摘要 · Abstract (English)
Person Re-Identification (ReID) is a fundamental task in computer vision with critical applications in surveillance and security. Despite progress in recent years, most existing ReID models often struggle to generalize across diverse cultural contexts, particularly in Islamic regions like Iran, where modest clothing styles are prevalent. Existing datasets predominantly feature Western and East Asian fashion, limiting their applicability in these settings. To address this gap, we introduce Iran University of Science and Technology Person Re-Identification (IUST_PersonReId), a dataset designed to reflect the unique challenges of ReID in new cultural environments, emphasizing modest attire and diverse scenarios from Iran, including markets, campuses, and mosques. Experiments on IUST_PersonReId with state-of-the-art models, such as Semantic Controllable Self-supervised Learning (SOLIDER) and Contrastive Language-Image Pretraining Re-Identification (CLIP-ReID), reveal significant performance drops compared to benchmarks like Market1501 and Multi-Scene MultiTime (MSMT17), specifically, SOLIDER shows a drop of 50.75% and 23.01% Mean Average Precision (mAP) compared to Market1501 and MSMT17 respectively, while CLIP-ReID exhibits a drop of 38.09% and 21.74% mAP, highlighting the challenges posed by occlusion and limited distinctive features. Sequence-based evaluations show improvements by leveraging temporal context, emphasizing the dataset's potential for advancing culturally sensitive and robust ReID systems. IUST_PersonReId offers a critical resource for addressing fairness and bias in ReID research globally.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。