arXiv:2606.15527cs.CVcs.AI2026-06

提出选择性协同学习,提升视频目标中心表征的精度与鲁棒性。

Selective Synergistic Learning for Video Object-Centric Learning

论文配图:Selective Synergistic Learning for Video Object-Centric Learning
图 1 · 摘自论文原文
  • 只保留可靠特征,分别用编码器优化边界、解码器净化内部区域。
  • 伪标签机制线性复杂度,避免全量对比的二次计算开销。
  • 适配不同槽位配置,可直接插入现有模型提升性能。

传统视频对象中心学习方法依赖基于槽位的架构,通过重建驱动的编码器-解码器框架实现学习,依赖编码器注意力图与解码器对象图两种空间映射。由于两者性质不同,近期密集对齐策略通过对比学习强制所有时空块间一致,但此方式无意中传播了模块固有缺陷,如噪声编码预测与模糊解码边界。同时,全对全相似性计算导致复杂度达时空块数平方,严重限制可扩展性。为此,本文提出选择性协同学习(SSync):不进行全量块对块对齐,而是仅选择性蒸馏最可靠信号——严格利用编码器进行边界精炼,解码器负责内部去噪。该机制通过线性复杂度伪标签实现,无需二次计算。此外,为抑制槽位冗余等架构偏差,引入基于时空激活一致性的传递式伪标签合并策略,整合重叠槽位。大量实验表明,SSync显著提升分解质量,可作为通用即插即用模块,且对槽位配置具有极强鲁棒性。代码已开源:github.com/wjun0830/SSync。

原文摘要 · Abstract (English)

Typical video object-centric learning (VOCL) approaches employ slot-based frameworks that rely on reconstruction-driven encoder-decoder architectures, where learning is mediated by two spatial maps: attention maps from the encoder and object maps from the decoder. As these two distinct maps exhibit different properties, a recent dense alignment strategy attempted to reconcile this discrepancy by enforcing agreement across all spatio-temporal patches via contrastive learning. However, this indiscriminate alignment inadvertently propagates the inherent weaknesses of each module, such as noisy encoder predictions and blurred decoder boundaries. Moreover, computing dense similarities across all pairs incurs a computational cost quadratic in the total number of spatio-temporal patches, severely limiting scalability. Motivated by this, we propose Selective Synergistic Learning (SSync). Instead of exhaustive patch-to-patch alignment, SSync prevents error propagation by selectively distilling only the most reliable cues: leveraging the encoder strictly for boundary refinement and the decoder for interior denoising. This is realized via a pseudo-labeling with linear complexity, eliminating the need for quadratic spatial comparisons. Also, to prevent the reinforcement of architectural biases like slot redundancy, we introduce a transitive pseudo-label merging that consolidates overlapping slots based on spatio-temporal activation consistency. Extensive studies demonstrate that SSync improves decomposition quality and serves as a versatile, plug-and-play module while also exhibiting exceptional robustness to slot configurations. Code is available at github.com/wjun0830/SSync.

视频理解目标分割协同学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。