arXiv:2605.31508cs.CV2026-05

不用额外损失,让视频物体模型自动保持时序一致性。

Internalizing Temporal Consistency in Video Object-Centric Learning without Explicit Regularization

论文配图:Internalizing Temporal Consistency in Video Object-Centric Learning without Explicit Regularization
图 1 · 摘自论文原文
  • 用通道分解和跨时重建,让模型隐式学习物体时序一致性。
  • 在多个数据集上达到新SOTA,且训练更高效。
  • 适合做视频物体发现与识别的研究者参考。

视频物体中心学习(OCL)旨在将物体表示为槽向量,并在帧间保持其一致性。槽-槽对比(SSC)损失已成为当前最优(SOTA)视频OCL方法的核心。尽管效果显著,但SSC依赖帧间一一对应关系并引入额外损失。遵循奥卡姆剃刀原则,我们提出范式转变:将时序一致性作为隐式模型设计而非显式损失来实现。为优雅地去除SSC(xSSC),我们引入两种近乎零开销的协同机制:(i)时序通道分解(CCD)在通道维度上结构化解耦槽表示为静态与动态子空间,形成经验上的统一信息瓶颈;(ii)跨时重建(CTR)通过融合当前槽的静态通道与目标槽的动态通道,以单个标准OCL解码器实现对当前或前一时刻特征的随机重建,仅需轻微训练调整。因此,槽集合仅通过最小化标准重建误差便自然学习到时序一致性。大量实验表明,将xSSC集成到主流基线中不仅提升训练效率,还在视频物体发现与识别任务上建立新SOTA。此外,主成分分析(PCA)与梯度分析证实,物体的时间不变语义与时间变化运动特性被分别编码至所提出的子空间中。源代码、模型检查点与训练日志已发布于https://github.com/Genera1Z/xSSC。

原文摘要 · Abstract (English)

Video Object-Centric Learning (OCL) aims to represent objects as \textit{slot} vectors and maintain their consistency across frames. Slot-Slot Contrastive (SSC) loss has become the cornerstone for state-of-the-art (SOTA) video OCL methods. While highly effective, SSC relies on one-to-one object correspondence across frames and introduces an extra loss. Following Occam's Razor, we propose a paradigm shift: temporal consistency is better enforced as an implicit model design rather than an explicit loss. To elegantly exclude SSC (\textbf{xSSC}), we introduce two quasi-zero-overhead synergistic mechanisms: (\textit{i}) Chrono-Channel Decomposition (CCD) structurally disentangles slot representations along the channel dimension into \textit{static} and \textit{dynamic} sub-spaces, serving as an empirically unified information bottleneck; (\textit{ii}) Cross-Temporal Reconstruction (CTR) stochastically reconstructs target features of either the current or previous time step by fusing current slots' static channels and target slots' dynamic channels, using a single standard OCL decoder with minor training adaptation. Thereby, the slot sets inherently learn temporal consistency by minimizing the standard reconstruction error alone. Extensive experiments show that integrating xSSC into leading baselines not only improves training efficiency but also establishes new SOTAs on video object discovery and recognition tasks. Furthermore, our PCA and gradient analyses confirm that objects' time-invariant semantics and time-variant kinematics are encoded into the proposed sub-spaces. Our source code, model checkpoints and training logs are provided on https://github.com/Genera1Z/xSSC.

视频生成物体中心时序一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。