arXiv:2507.11985cs.CV2025-07ICCV被引 1

无监督发现物体局部部件,通过修复掩码区域实现精准对齐

Unsupervised Part Discovery via Descriptor-Based Masked Image Restoration with Optimized Constraints

  • 用部分描述符重建掩码图像块,基于特征相似性填充
  • 在多类别复杂场景下仍能稳定发现符合真实形状的部件
  • 适合处理遮挡问题,可探索跨类别部件相似性

局部特征对图像理解至关重要,但因缺乏细粒度标注,研究较少。现有无监督部件发现方法在不同类别和场景中鲁棒性差,限制了应用范围。为此,本文提出掩码部件自编码器(MPAE),先从输入学习部件描述符与特征图,再生成原始图像掩码版本的补丁特征。利用局部特征与描述符的相似性,将掩码区域用学习到的描述符进行重建,使修复后的图像块更贴合实际部件形状,同时受未掩码区域外观特征引导。通过引入更宽松但更有效的约束,MPAE可在无监督条件下识别多种场景下的部件存在。实验表明,该方法在多个类别和复杂场景中均能稳健发现有意义的部件,为遮挡处理及跨类别部件相似性探索提供基础。代码已公开于 https://github.com/Jiahao-UTS/MPAE。

原文摘要 · Abstract (English)

Part-level features are crucial for image understanding, but few studies focus on them because of the lack of fine-grained labels. Although unsupervised part discovery can eliminate the reliance on labels, most of them cannot maintain robustness across various categories and scenarios, which restricts their application range. To overcome this limitation, we present a more effective paradigm for unsupervised part discovery, named Masked Part Autoencoder (MPAE). It first learns part descriptors as well as a feature map from the inputs and produces patch features from a masked version of the original images. Then, the masked regions are filled with the learned part descriptors based on the similarity between the local features and descriptors. By restoring these masked patches using the part descriptors, they become better aligned with their part shapes, guided by appearance features from unmasked patches. Finally, MPAE robustly discovers meaningful parts that closely match the actual object shapes, even in complex scenarios. Moreover, several looser yet more effective constraints are proposed to enable MPAE to identify the presence of parts across various scenarios and categories in an unsupervised manner. This provides the foundation for addressing challenges posed by occlusion and for exploring part similarity across multiple categories. Extensive experiments demonstrate that our method robustly discovers meaningful parts across various categories and scenarios. The code is available at the project https://github.com/Jiahao-UTS/MPAE.

无监督学习部件发现图像修复特征对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。