arXiv:2507.02308cs.CV2025-07

用类别标签训练,自动发现物体关键点,精度接近有标注模型。

LMPNet for Weakly-supervised Keypoint Discovery

  • 通过漏桶最大池化层让卷积滤波器学习非重复局部模式
  • 关键点检测对姿态变化鲁棒,精度媲美有监督模型
  • 方法可解释性强,适合需要理解模型决策的场景

本文研究仅用类别标签弱监督下的语义物体关键点发现任务。通过将判别性训练的中间层滤波器转换为关键点检测器实现。我们识别出关键点检测器的三个理想特性:(i) 空间稀疏激活,(ii) 一致性,(iii) 多样性。提出一种计算高效的漏桶最大池化(LMP)层,显式鼓励最终卷积层滤波器学习与物体关键点对齐的“非重复局部模式”。基于可视化结果,设计简单有效的选择策略以确保滤波器激活的一致性,并引入注意力掩码机制迫使网络关注整个物体而非仅最显著区域。最终通过可学习聚类层将关键点候选整合为预测结果。所提模型LMPNet具有高度可解释性,直接操控网络滤波器检测预定义概念。实验表明,LMPNet能自动发现对姿态变化鲁棒的语义关键点,且预测精度接近有监督姿态估计模型。

原文摘要 · Abstract (English)

In this work, we explore the task of semantic object keypoint discovery weakly-supervised by only category labels. This is achieved by transforming discriminatively-trained intermediate layer filters into keypoint detectors. We begin by identifying three preferred characteristics of keypoint detectors: (i) spatially sparse activations, (ii) consistency and (iii) diversity. Instead of relying on hand-crafted loss terms, a novel computationally-efficient leaky max pooling (LMP) layer is proposed to explicitly encourage final conv-layer filters to learn "non-repeatable local patterns" that are well aligned with object keypoints. Informed by visualizations, a simple yet effective selection strategy is proposed to ensure consistent filter activations and attention mask-out is then applied to force the network to distribute its attention to the whole object instead of just the most discriminative region. For the final keypoint prediction, a learnable clustering layer is proposed to group keypoint proposals into keypoint predictions. The final model, named LMPNet, is highly interpretable in that it directly manipulates network filters to detect predefined concepts. Our experiments show that LMPNet can (i) automatically discover semantic keypoints that are robust to object pose and (ii) achieves strong prediction accuracy comparable to a supervised pose estimation model.

关键点发现弱监督可解释性姿态估计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。