arXiv:2603.24134cs.CV2026-03

通过频域滤波增强相邻动作差异,提升骨骼动作分割精度

Spectral Scalpel: Amplifying Adjacent Action Discrepancy via Frequency-Selective Filtering for Skeleton-Based Action Segmentation

  • 用自适应多尺度频域滤波器切除共性频率,放大动作特异性频率
  • 在5个公开数据集上达到当前最优性能,边界定位更清晰
  • 适合做动作分割、时序建模与频域分析的研究者参考

基于骨架的时序动作分割(STAS)旨在对长且未剪辑的骨骼运动序列进行密集分割与分类。然而现有方法因相邻动作间时空模式区分度不足,导致类间判别能力弱、分割边界模糊。为此,本文提出Spectral Scalpel,一种频域选择性滤波框架,通过抑制相邻不同动作间的共享频率成分,同时放大其特有的频率分量,增强动作间差异性并锐化转换边界。具体而言,Spectral Scalpel采用自适应多尺度谱滤波器作为“手术刀”对频谱进行编辑,并以相邻动作间的差异损失作为优化目标,有效提升邻近动作的表征差异,缓解边界定位歧义与类间混淆问题。此外,为补充长期时序建模,引入频域感知通道混合器,通过跨通道频谱聚合强化通道演化。该工作提出了全新的STAS范式,将传统时空建模扩展至频域分析。在五个公开数据集上的大量实验表明,Spectral Scalpel实现当前最优性能。代码已开源:https://github.com/HaoyuJi/SpecScalpel。

原文摘要 · Abstract (English)

Skeleton-based Temporal Action Segmentation (STAS) seeks to densely segment and classify diverse actions within long, untrimmed skeletal motion sequences. However, existing STAS methodologies face challenges of limited inter-class discriminability and blurred segmentation boundaries, primarily due to insufficient distinction of spatio-temporal patterns between adjacent actions. To address these limitations, we propose Spectral Scalpel, a frequency-selective filtering framework aimed at suppressing shared frequency components between adjacent distinct actions while amplifying their action-specific frequencies, thereby enhancing inter-action discrepancies and sharpening transition boundaries. Specifically, Spectral Scalpel employs adaptive multi-scale spectral filters as scalpels to edit frequency spectra, coupled with a discrepancy loss between adjacent actions serving as the surgical objective. This design amplifies representational disparities between neighboring actions, effectively mitigating boundary localization ambiguities and inter-class confusion. Furthermore, complementing long-term temporal modeling, we introduce a frequency-aware channel mixer to strengthen channel evolution by aggregating spectra across channels. This work presents a novel paradigm for STAS that extends conventional spatio-temporal modeling by incorporating frequency-domain analysis. Extensive experiments on five public datasets demonstrate that Spectral Scalpel achieves state-of-the-art performance. Code is available at https://github.com/HaoyuJi/SpecScalpel.

动作分割频域分析骨骼序列时序建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。