arXiv:2608.17487cs.CV2026-08中稿 · Pattern Recognitio…

受大脑通路启发,分路建模骨骼空间与运动信息,提升动作识别准确率。

NeuroPath: Brain-Inspired Dual-Pathway Graph Convolutional Networks for Skeleton-Based Action Recognition

论文配图:NeuroPath: Brain-Inspired Dual-Pathway Graph Convolutional Networks for Skeleton-Based Action Recognition
图 1 · 摘自论文原文
  • 分两条路径分别处理空间结构和运动时序信息,避免相互干扰。
  • 在三个主流数据集上均实现显著提升,最高准确率超现有方法。
  • 适合需要精细动作理解的场景,如医疗康复、人机交互。

基于骨架的动作识别旨在从人体关节点坐标序列中识别动作。现有时空图卷积网络(STGCNs)通过隐式建模骨架结构取得良好效果,但我们的实证研究发现不同骨架模态间存在明显性能差异,表明隐式耦合时空信息限制了结构与运动线索的充分挖掘。受人类感知中腹侧与背侧通路启发,我们提出双路径图卷积网络(NeuroPath),采用双路径架构分别且协作地建模空间与时间信息。具体而言,转换单元将输入转化为路径专用的骨架表示,使每条路径聚焦于人体运动的不同方面。为捕捉协同关节行为及其关系,引入组图卷积块,动态识别关键身体部位并建模其时空依赖。此外,跨路径动态融合模块整合路径间的互补信息,促进动作的高层次语义理解。在Kinetics Skeleton 400、NTU RGB+D 60和NTU RGB+D 120上的大量实验表明,该方法持续提升性能,验证了双路径时空建模的有效性。

原文摘要 · Abstract (English)

Skeleton-based action recognition aims to recognize human actions from sequences of human joint coordinates. Most existing Spatial-Temporal Graph Convolutional Networks (STGCNs) have achieved promising results by modeling skeletal structures with implicit spatial-temporal representations. However, our empirical study reveals a clear performance imbalance across different skeletal modalities, indicating that implicitly coupling spatial and temporal information limits the full exploitation of complementary structural and motion cues. Inspired by the ventral and dorsal pathways in human perception, we propose Dual-Pathway Graph Convolutional Networks (NeuroPath), which adopt a dual-pathway architecture for separate yet collaborative modeling of spatial and temporal information. Specifically, transformation units first convert the input into pathway-specific skeletal representations, allowing each pathway to focus on complementary aspects of human motion. To further capture coordinated joint behaviors and their interrelationships, we introduce a group graph convolution block that dynamically identifies key body parts and models their spatial-temporal dependencies. In addition, inter-pathway dynamic fusion modules integrate complementary inter-modal information across pathways, facilitating higher-level semantic interpretation of actions. Extensive experiments on Kinetics Skeleton 400, NTU RGB+D 60, and NTU RGB+D 120 demonstrate consistent performance improvements, validating the effectiveness of dual-pathway spatial-temporal modeling for skeleton-based action recognition.

动作识别图神经网络骨架分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。