arXiv:2412.13463cs.CVcs.AI2024-12AAAI

用少量标注数据适配预训练姿态生成器,实现跨数据集精准姿态迁移。

FlexPose: Pose Distribution Adaptation with Limited Guidance

  • 将姿态坐标视为骨架图像,通过微调线性层实现分布自适应。
  • 仅需少量标注即可生成与目标分布一致的高质量姿态。
  • 适合缺乏标注数据的跨数据集姿态生成任务,尤其适用于新采集图像。

目前已有大量标注完善的人体关键点数据集,但为新采集图像标注人体姿态仍耗时耗力。不同数据集的姿态分布具有相似的关节结构先验,仅存在如枢轴方向、关节旋转和骨骼长度比等几何变换差异。姿态分布的差异本质是变换分布的差异。受此启发,我们提出一种方法,可校准已学习姿态先验的预训练姿态生成器,使其适配新的姿态分布。我们将人体关节坐标表示为骨架图像,仅需少量标注引导,即可通过微调与姿态变换密切相关的少量线性层,实现预训练姿态标注生成器的迁移。经验证,该方法在多个跨数据集设置中均达到当前基于生成模型的迁移学习方法的领先性能,且在有限标注条件下表现优异。

原文摘要 · Abstract (English)

Numerous well-annotated human key-point datasets are publicly available to date. However, annotating human poses for newly collected images is still a costly and time-consuming progress. Pose distributions from different datasets share similar pose hinge-structure priors with different geometric transformations, such as pivot orientation, joint rotation, and bone length ratio. The difference between Pose distributions is essentially the difference between the transformation distributions. Inspired by this fact, we propose a method to calibrate a pre-trained pose generator in which the pose prior has already been learned to an adapted one following a new pose distribution. We treat the representation of human pose joint coordinates as skeleton image and transfer a pre-trained pose annotation generator with only a few annotation guidance. By fine-tuning a limited number of linear layers that closely related to the pose transformation, the adapted generator is able to produce any number of pose annotations that are similar to the target poses. We evaluate our proposed method, FlexPose, on several cross-dataset settings both qualitatively and quantitatively, which demonstrates that our approach achieves state-of-the-art performance compared to the existing generative-model-based transfer learning methods when given limited annotation guidance.

姿态生成迁移学习少样本生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。