用可学习的图函数提升3D人体姿态估计,更好捕捉远距离依赖。
Adaptive graph Kolmogorov-Arnold network for 3D human pose estimation
- 基于图的KAN网络,边上的激活函数可学习,适应性强。
- 多跳特征聚合让关节能利用远距离信息,改善空间感知。
- 适合处理遮挡和深度模糊问题,适合高精度姿态估计场景。
基于图卷积网络(GCN)的方法在3D人体姿态估计中表现优异,因其天然契合人体骨骼的图结构。然而,其局部感受野限制了对长程依赖的建模能力,难以应对遮挡和深度歧义;同时存在谱偏差,偏好低频成分而难以捕捉高频细节。本文提出PoseKAN,一种用于单图像2D到3D姿态提升的自适应图柯尔莫戈洛夫-阿诺德网络(KAN)框架。与使用固定激活函数的GCN不同,KAN在图边上采用可学习函数,实现数据驱动的自适应特征变换,显著提升模型表达能力。通过多跳特征聚合,使身体关节能融合局部与远端邻居信息,增强空间感知。引入残差PoseKAN模块以深化特征提炼,并采用全局响应归一化提升特征选择性和对比度。大量实验表明,该模型在多个基准数据集上达到先进水平。
原文摘要 · Abstract (English)
Graph convolutional network (GCN)-based methods have shown strong performance in 3D human pose estimation by leveraging the natural graph structure of the human skeleton. However, their local receptive field limits their ability to capture long-range dependencies essential for handling occlusions and depth ambiguities. They also exhibit spectral bias, which prioritizes low-frequency components while struggling to model high-frequency details. In this paper, we introduce PoseKAN, an adaptive graph Kolmogorov-Arnold Network (KAN), framework that extends KANs to graph-based learning for 2D-to-3D pose lifting from a single image. Unlike GCNs that use fixed activation functions, KANs employ learnable functions on graph edges, allowing data-driven, adaptive feature transformations. This enhances the model's adaptability and expressiveness, making it more expressive in learning complex pose variations. Our model employs multi-hop feature aggregation, ensuring the body joints can leverage information from both local and distant neighbors, leading to improved spatial awareness. It also incorporates residual PoseKAN blocks for deeper feature refinement, and a global response normalization for improved feature selectivity and contrast. Extensive experiments on benchmark datasets demonstrate the competitive performance of our model against state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。