arXiv:2504.05789cs.CV2025-04CVPR被引 2

用合成成人数据训练婴儿姿态估计,无需标注也能精准识别。

Leveraging Synthetic Adult Datasets for Unsupervised Infant Pose Estimation

  • 用伪标签和师生一致性框架弥补婴儿数据少的缺陷。
  • 在多个基准上比现有无监督方法高5%,比有监督方法高16%。
  • 适合医疗健康领域中缺乏标注数据的婴儿动作分析场景。

人体姿态估计在医疗应用中至关重要。尽管成人姿态估计已取得显著进展,但针对婴儿的研究仍有限。现有婴儿姿态估计方法虽表现良好,但依赖大量标注数据,且在分布偏移下泛化能力差。为此,我们提出SHIFT:利用合成成人数据进行无监督婴儿姿态估计,采用基于伪标签的均值教师框架缓解标注数据不足问题,并通过学生与教师伪标签的一致性约束应对分布偏移。此外,引入婴儿姿态流形先验以惩罚不合理预测;为提升自遮挡感知能力,设计新型可见性一致性模块,增强预测姿态与原始图像的对齐。在多个基准上的实验表明,SHIFT显著优于现有最先进的无监督域适应姿态估计方法(提升5%),并领先于有监督婴儿姿态估计方法达16%。项目页面:https://sarosijbose.github.io/SHIFT。

原文摘要 · Abstract (English)

Human pose estimation is a critical tool across a variety of healthcare applications. Despite significant progress in pose estimation algorithms targeting adults, such developments for infants remain limited. Existing algorithms for infant pose estimation, despite achieving commendable performance, depend on fully supervised approaches that require large amounts of labeled data. These algorithms also struggle with poor generalizability under distribution shifts. To address these challenges, we introduce SHIFT: Leveraging SyntHetic Adult Datasets for Unsupervised InFanT Pose Estimation, which leverages the pseudo-labeling-based Mean-Teacher framework to compensate for the lack of labeled data and addresses distribution shifts by enforcing consistency between the student and the teacher pseudo-labels. Additionally, to penalize implausible predictions obtained from the mean-teacher framework, we incorporate an infant manifold pose prior. To enhance SHIFT's self-occlusion perception ability, we propose a novel visibility consistency module for improved alignment of the predicted poses with the original image. Extensive experiments on multiple benchmarks show that SHIFT significantly outperforms existing state-of-the-art unsupervised domain adaptation (UDA) pose estimation methods by 5% and supervised infant pose estimation methods by a margin of 16%. The project page is available at: https://sarosijbose.github.io/SHIFT.

姿态估计无监督学习婴儿动作医疗应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。