arXiv:2605.05753cs.CV2026-05

提出TDSC方法,联合学习时序一致的结构化表示与稳定亲和度,提升动作分割精度。

Jointly Learning Structured Representations and Stabilized Affinity for Human Motion Segmentation

论文配图:Jointly Learning Structured Representations and Stabilized Affinity for Human Motion Segmentation
图 1 · 摘自论文原文
  • 通过自表达模型交替学习帧特征表示与系数,引入编码率最大化防坍缩
  • 在5个基准数据集上使用HoG/CLIP/DINOv2特征均超越现有方法
  • 设计时序动量平均与重参数化策略,优化稳定且高效

人体动作分割(HMS)旨在将视频划分为互不重叠、对应不同动作的段落,近年来受到广泛关注。现有方法多基于子空间聚类,依赖于高维时序特征分布符合并集子空间(UoS)假设。然而真实视频中原始帧级特征常违背此假设,导致分割性能不佳。为此,本文提出一种高效有效的HMS方法——时序深度自表达子空间聚类(TDSC),联合学习时序一致的结构化表示与稳定亲和度。TDSC中,通过正则化的自表达模型交替学习输入帧特征的结构化表示与自表达系数,引入编码率最大化正则项防止表示坍缩,并使学习表示符合目标UoS分布;同时加入时序约束,促使相邻帧被分入同一组。此外,设计时序动量平均机制以稳定亲和度演化,并提出重参数化策略实现高效优化。在五个基准数据集上,采用传统(HoG)与最新深度特征(CLIP、DINOv2)进行大量实验,验证了该方法的有效性。

原文摘要 · Abstract (English)

Human Motion Segmentation (HMS), which aims to partition a video into non-overlapping segments corresponding to different human motions, has recently attracted increasing research attention. Existing HMS approaches are predominantly based on subspace clustering, which are grounded on the assumption that the distribution of high-dimensional temporal features well aligns with a Union-of-Subspaces (UoS). For videos in the real world, however, the raw frame-level features often violate the UoS assumption and yield unsatisfactory segmentation performance. To address this issue, we propose an efficient and effective approach for HMS, named Temporal Deep Self-expressive subspace Clustering (TDSC), which jointly learns temporally consistent structured representations and stabilized affinity for accurate and robust HMS. Specifically, in TDSC, we alternately learn structured representations of the input frame features and self-expressive coefficients via a properly regularized self-expressive model, in which a coding-rate maximization regularizer is incorporated to avoid representation collapse and conform the learned representations to span a desired UoS distribution, and meanwhile, temporal constraints are incorporated to promote temporally adjacent frames to be partitioned into the same groups. Moreover, we develop a temporal momentum averaging mechanism to stabilize affinity evolution and design a reparameterization strategy to enable efficient optimization. We conduct extensive experiments on five benchmark HMS datasets using both conventional (HoG) and up-to-date deep features (i.e., CLIP, DINOv2) to validate the effectiveness of our approach.

动作分割子空间聚类时序建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。