提出新框架,同时聚合共性特征、分离特有特征,提升跨域人体姿态估计性能。
Exploiting Aggregation and Segregation of Representations for Domain Adaptive Human Pose Estimation
- 将特征解耦为通用与特定部分,分别聚合和分离以增强适应性
- 在Human3.6M等4个基准上达到当前最优性能
- 适合需要跨域迁移的人体姿态估计研究者使用
人体姿态估计因在动作分析、虚拟现实、医疗等领域的广泛应用而备受关注。然而,由于真实世界数据标注耗时耗力,缺乏多样化标注数据。为解决标签不足问题,通常采用易获取的合成数据(源域)训练模型,并通过领域自适应(DA)将其应用于真实数据(目标域)。然而,现有方法多聚焦于源与目标特征的对齐与聚合,忽视了剔除领域特异性表示的重要性。为此,本文提出一种新框架,同时利用表征的聚合与分离。在架构层面,将特征解耦为领域不变与领域特定成分,实现前者聚合、后者分离;在差异度量方面,深入分析关键点间关系,对不同关系采用独立的聚合或分离机制以提升对齐效果。在Human3.6M、LSP、H3D和FreiHand等多个基准上的大量实验表明,该方法持续取得领先性能。项目代码已公开于https://github.com/davidpengucf/EPIC。
原文摘要 · Abstract (English)
Human pose estimation (HPE) has received increasing attention recently due to its wide application in motion analysis, virtual reality, healthcare, etc. However, it suffers from the lack of labeled diverse real-world datasets due to the time- and labor-intensive annotation. To cope with the label deficiency issue, one common solution is to train the HPE models with easily available synthetic datasets (source) and apply them to real-world data (target) through domain adaptation (DA). Unfortunately, prevailing domain adaptation techniques within the HPE domain remain predominantly fixated on effecting alignment and aggregation between source and target features, often sidestepping the crucial task of excluding domain-specific representations. To rectify this, we introduce a novel framework that capitalizes on both representation aggregation and segregation for domain adaptive human pose estimation. Within this framework, we address the network architecture aspect by disentangling representations into distinct domain-invariant and domain-specific components, facilitating aggregation of domain-invariant features while simultaneously segregating domain-specific ones. Moreover, we tackle the discrepancy measurement facet by delving into various keypoint relationships and applying separate aggregation or segregation mechanisms to enhance alignment. Extensive experiments on various benchmarks, e.g., Human3.6M, LSP, H3D, and FreiHand, show that our method consistently achieves state-of-the-art performance. The project is available at \url{https://github.com/davidpengucf/EPIC}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。