arXiv:2604.21572cs.CV2026-04中稿 · ICPR 2026

用深度核空间逼近视频帧分布,无监督分割动作更准更快。

Deep kernel video approximation for unsupervised action segmentation

论文配图:Deep kernel video approximation for unsupervised action segmentation
图 1 · 摘自论文原文
  • 在神经正切核定义的深度核空间中用MMD度量分布相似性
  • 六项基准测试表现达顶尖水平,未知段数时F1更高
  • 避免平凡解,适合数据受限场景的视频动作分割

本研究聚焦于每视频无监督动作分割,适用于无法存储大规模数据集的应用场景。通过在深度核空间中学习以尽可能逼近原始帧分布,实现视频分割。采用最大均值差异(MMD)作为分布间接近度度量,因其在分布空间中保持几何结构,估计更可靠。相比常用最优传输度量,MMD优化更简便且计算更快。选用神经正切核(NTKs)定义核空间,因其相比固定核具有更强表达能力,并可避免联合学习输入与核函数时的平凡解。在六个标准基准上,本方法表现优于现有最先进每视频方法;当段数未知时,其F1分数高于以往分层聚类方法。

原文摘要 · Abstract (English)

This work focuses on per-video unsupervised action segmentation, which is of interest to applications where storing large datasets is either not possible, or nor permitted. We propose to segment videos by learning in deep kernel space, to approximate the underlying frame distribution, as closely as possible. To define this closeness metric between the original video distribution and its approximation, we rely on maximum mean discrepancy (MMD) which is a geometry-preserving metric in distribution space, and thus gives more reliable estimates. Moreover, unlike the commonly used optimal transport metric, MMD is both easier to optimize, and faster. We choose to use neural tangent kernels (NTKs) to define the kernel space where MMD operates, because of their improved descriptive power as opposed to fixed kernels. And, also, because NTKs sidestep the trivial solution, when jointly learning the inputs (video approximation) and the kernel function. Finally, we show competitive results when compared to state-of-the-art per-video methods, on six standard benchmarks. Additionally, our method has higher F1 scores than prior agglomerative work, when the number of segments is unknown.

动作分割无监督学习深度核方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。