arXiv:2410.00348cs.CV2024-10

利用3D纹理增强人物重识别,提升准确率与可解释性

Revisiting the Role of Texture in 3D Person Re-identification

  • 通过UV纹理映射突出3D人体纹理特征
  • 在三个基准数据集上达到最新最优性能
  • 可视化关键区域,适合关注可解释性的研究者

本研究提出一种新的3D人物重识别框架,利用3D重建中可获取的高分辨率纹理数据,提升人物重识别的性能与可解释性。通过引入UVTexture映射,强化3D模型中的纹理特征表达,更好地区分不同个体。该方法创新性地结合3D模型与纹理热图,利用激活图和基于属性的注意力图实现重识别过程的可视化与解释。实验表明,在三个公开基准数据集上均达到当前最优性能。所有数据、代码与模型已开源,确保结果可复现。

原文摘要 · Abstract (English)

This study introduces a new framework for 3D person re-identification (re-ID) that leverages readily available high-resolution texture data in 3D reconstruction to improve the performance and explainability of the person re-ID task. We propose a method to emphasize texture in 3D person re-ID models by incorporating UVTexture mapping, which better differentiates human subjects. Our approach uniquely combines UVTexture and its heatmaps with 3D models to visualize and explain the person re-ID process. In particular, the visualization and explanation are achieved through activation maps and attribute-based attention maps, which highlight the important regions and features contributing to the person re-ID decision. Our contributions include: (1) a novel technique for emphasizing texture in 3D models using UVTexture processing, (2) an innovative method for explicating person re-ID matches through a combination of 3D models and UVTexture mapping, and (3) achieving state-of-the-art performance in 3D person re-ID. We ensure the reproducibility of our results by making all data, codes, and models publicly available.

3D重识别纹理建模可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。