利用3D纹理增强人物重识别,提升准确率与可解释性
Revisiting the Role of Texture in 3D Person Re-identification
- 通过UV纹理映射突出3D人体纹理特征
- 在三个基准数据集上达到最新最优性能
- 可视化关键区域,适合关注可解释性的研究者
本研究提出一种新的3D人物重识别框架,利用3D重建中可获取的高分辨率纹理数据,提升人物重识别的性能与可解释性。通过引入UVTexture映射,强化3D模型中的纹理特征表达,更好地区分不同个体。该方法创新性地结合3D模型与纹理热图,利用激活图和基于属性的注意力图实现重识别过程的可视化与解释。实验表明,在三个公开基准数据集上均达到当前最优性能。所有数据、代码与模型已开源,确保结果可复现。
原文摘要 · Abstract (English)
This study introduces a new framework for 3D person re-identification (re-ID) that leverages readily available high-resolution texture data in 3D reconstruction to improve the performance and explainability of the person re-ID task. We propose a method to emphasize texture in 3D person re-ID models by incorporating UVTexture mapping, which better differentiates human subjects. Our approach uniquely combines UVTexture and its heatmaps with 3D models to visualize and explain the person re-ID process. In particular, the visualization and explanation are achieved through activation maps and attribute-based attention maps, which highlight the important regions and features contributing to the person re-ID decision. Our contributions include: (1) a novel technique for emphasizing texture in 3D models using UVTexture processing, (2) an innovative method for explicating person re-ID matches through a combination of 3D models and UVTexture mapping, and (3) achieving state-of-the-art performance in 3D person re-ID. We ensure the reproducibility of our results by making all data, codes, and models publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。