用动态骨骼信息生成连续热图,提升低精度传感器动作识别效果
KGS-GCN: Kinematics-Driven Gaussian Splatting and Probabilistic Topology for Skeleton-Based Action Recognition
- 通过速度向量构建高斯点云,将离散骨骼转为多视角连续热图
- 用贝塔距离建模关节统计相关性,自适应生成拓扑连接矩阵
- 参数仅140万,计算量1.3 GFLOPs,适合边缘设备部署
基于骨架的动作识别广泛应用于人机交互和智能监控等传感系统。然而,典型传感器输出稀疏离散的关节点坐标,常导致动态运动中细粒度时空信息丢失;且预设物理拓扑限制了长程依赖建模。为此,我们提出KGS-GCN,将运动学驱动的高斯点云与概率拓扑整合进图卷积网络。高斯点云模块通过提取瞬时关节速度向量构建各向异性协方差矩阵,将稀疏骨架序列转化为富含时空语义的多视角连续热图。同时,概率拓扑构建策略利用巴氏距离量化关节高斯分布间的统计相关性,生成自适应先验邻接矩阵,突破物理连接限制。最后,轻量级多视图渲染分支与拓扑图卷积主干通过视觉上下文门控机制统一,实现连续动态线索与结构先验的无缝融合,保持高效率:仅需140万参数和1.3 GFLOPs。在多个基准数据集上的大量实验表明,KGS-GCN显著提升了复杂时空动态建模能力,在低计算开销下取得竞争力表现,为提升低质量传感器数据的感知鲁棒性提供了高效范式。
原文摘要 · Abstract (English)
Skeleton-based action recognition is widely applied in sensor-based systems, including human-computer interaction and intelligent surveillance. However, typical sensors produce sparse and discrete joint coordinates, often leading to the loss of fine-grained spatiotemporal information during dynamic movements. Furthermore, predefined physical topologies restrict modeling potential long-range dependencies. To address these challenges, we propose KGS-GCN, which integrates kinematics-driven Gaussian splatting and probabilistic topology within a graph convolutional network. A Gaussian splatting module constructs anisotropic covariance matrices by extracting instantaneous joint velocity vectors, rendering sparse skeleton sequences into multi-view continuous heatmaps rich in spatiotemporal semantics. Additionally, a probabilistic topology construction strategy transcends physical connectivity limitations by utilizing the Bhattacharyya distance to quantify statistical correlations between joint Gaussian distributions, generating an adaptive prior adjacency matrix. Finally, the lightweight multi-view rendering branch and topological GCN backbone are unified through a visual context gating mechanism, enabling seamless fusion of continuous dynamic cues with structural priors while maintaining high computational efficiency, requiring only 1.4M parameters and 1.3 GFLOPs. Extensive experiments on multiple benchmark datasets demonstrate that KGS-GCN significantly enhances the modeling of complex spatiotemporal dynamics and achieves competitive performance at low computational cost, establishing an efficient paradigm for improving the perceptual robustness of low-fidelity sensor data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。