构建统一框架,让模型能准确识别健全、残肢和假肢的姿势。
Topology-Unified 2D Pose Estimation across Intact, Residual and Prosthetic Limbs

- 提出新标注协议,统一生物肢体与假肢结构的拓扑表示
- 用合成数据填补真实数据稀缺问题,长尾假肢关节识别准确率提升2%-6%
- 设计结构感知损失,防止模型在机械结构上误判不存在的关节
受大规模数据集推动,人体姿态估计在众多下游任务中发挥关键作用。然而主流基准存在严重代表性偏差,主要包含健全个体。尽管少数开创性数据集尝试涵盖肢体差异,其标注协议难以泛化,无法有效表示跑步刀片等特殊机械结构或未安装假肢的残肢。为弥合这一差距,我们提出ProPose,一个大规模基准,采用新型标注协议,将生物肢体、多样化假肢及肢体缺失统一在单一框架中。由于真实假肢图像稀缺且呈极端长尾分布,我们设计了真实到合成的数据扩展管道,显式合成并扩充低频案例。然而,直接在该增强数据集上训练现有模型常导致次优结果,因其独立估计每个关键点,可能在机械结构上幻觉出不存在的关节。为此,我们提出ProLoss,一种结构感知目标函数,强制单个肢体内部关键点间的依赖关系,防止不合理的肢体预测。大量实验表明,该方法在不牺牲空间坐标定位性能的前提下,使长尾假肢关节分类准确率提升2%至6%。本工作为包容性姿态估计奠定基础,开启了理解人体与辅助设备交互的新可能。
原文摘要 · Abstract (English)
Driven by the availability of large-scale datasets, Human Pose Estimation (HPE) plays a critical role in numerous downstream tasks. However, mainstream benchmarks exhibit severe representation bias, predominantly featuring able-bodied individuals. While a few pioneering datasets have attempted to address limb differences, their annotation protocols fail to generalize, struggling to represent specialized mechanical structures like running blades or unprosthetized residual limbs. To bridge this gap, we introduce ProPose, a large-scale benchmark featuring a novel annotation protocol that unifies the topological representation of biological limbs, diverse prostheses, and physical absences within a single framework. Because real-world prosthetic images are inherently scarce and exhibit extreme long-tail distributions, we design a Real-to-Synthetic data expansion pipeline to explicitly synthesize and expand the underrepresented cases. However, simply training existing models on this enriched dataset often leads to suboptimal solutions, as they estimate each keypoint independently and might hallucinate non-existent joints on mechanical structures. To resolve this, we propose ProLoss, a structure-aware objective that enforces keypoint dependencies within a single limb to prevent unrealistic limb predictions. Extensive experiments demonstrate that our approach improves the classification accuracy of long-tail prosthetic joints by 2% to 6% without compromising spatial coordinate localization performance. This work sets a foundation for inclusive pose estimation, unlocking new possibilities for understanding the interactions between human bodies and assistive devices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。