arXiv:2508.04513cs.CV2025-08ICCV被引 8

无需标注数据,用骨架动作词自动分割动作片段。

Skeleton Motion Words for Unsupervised Skeleton-Based Temporal Action Segmentation

论文配图:Skeleton Motion Words for Unsupervised Skeleton-Based Temporal Action Segmentation
图 1 · 摘自论文原文
  • 通过序列到序列自编码器保持关节信息独立,生成骨架嵌入。
  • 将嵌入序列分块量化为独特动作词,发现语义动作簇。
  • 在三个数据集上超越现有无监督方法,适合隐私保护场景。

基于骨架的时序动作分割当前主流方法依赖标注数据,成本高昂。而现有无监督方法多针对视频数据,骨架序列研究不足,尽管其在实际应用中具有鲁棒性和隐私保护优势。本文提出一种新型无监督骨架时序动作分割方法:使用序列到序列的时序自编码器,在嵌入空间中保持不同关节信息的解耦;将潜在骨架序列划分为不重叠块并量化为独特的骨架动作词,从而驱动语义动作簇的发现。在HuGaDB、LARa、BABEL三个常用骨架数据集上进行了全面评估,结果表明该模型优于当前最先进的无监督方法。代码已公开于https://github.com/bachlab/SMQ。

原文摘要 · Abstract (English)

Current state-of-the-art methods for skeleton-based temporal action segmentation are predominantly supervised and require annotated data, which is expensive to collect. In contrast, existing unsupervised temporal action segmentation methods have focused primarily on video data, while skeleton sequences remain underexplored, despite their relevance to real-world applications, robustness, and privacy-preserving nature. In this paper, we propose a novel approach for unsupervised skeleton-based temporal action segmentation. Our method utilizes a sequence-to-sequence temporal autoencoder that keeps the information of the different joints disentangled in the embedding space. Latent skeleton sequences are then divided into non-overlapping patches and quantized to obtain distinctive skeleton motion words, driving the discovery of semantically meaningful action clusters. We thoroughly evaluate the proposed approach on three widely used skeleton-based datasets, namely HuGaDB, LARa, and BABEL. The results demonstrate that our model outperforms the current state-of-the-art unsupervised temporal action segmentation methods. Code is available at https://github.com/bachlab/SMQ .

动作分割无监督学习骨架分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。