arXiv:2602.03390cs.CVcs.LG2026-02被引 3

提出协同表示学习,打破视频对象中心学习的模糊循环

From Vicious to Virtuous Cycles: Synergistic Representation Learning for Unsupervised Video Object-Centric Learning

  • 编码器与解码器互相优化:利用清晰特征去模糊解码输出,用一致结构去降噪编码特征
  • 在视频对象中心数据集上达到当前最优性能,显著提升边界清晰度和对象分离质量
  • 适合关注无监督视频理解、对象分割与生成模型的科研人员

无监督对象中心学习模型,尤其是基于槽位的架构,在分解复杂场景方面展现出巨大潜力。然而,其依赖重建训练导致编码器的高频率注意力图与解码器的空间一致性但模糊的重建图之间存在根本矛盾。这种差异引发恶性循环:编码器的噪声特征迫使解码器进行平均处理,产生更模糊的输出;而模糊重建图的梯度又缺乏高频细节,无法有效监督编码器特征。为此,我们提出协同表示学习(SRL),建立编码器与解码器相互优化的良性循环。SRL利用编码器的清晰性来去模糊解码输出中的语义边界,同时利用解码器的空间一致性来降噪编码器特征。该互惠优化过程通过一个预热阶段稳定,该阶段采用槽位正则化目标,初始时为每个槽位分配独立实体。通过弥合编码器与解码器之间的表征鸿沟,SRL在视频对象中心学习基准上取得当前最优结果。代码已开源:https://github.com/hynnsk/SRL。

原文摘要 · Abstract (English)

Unsupervised object-centric learning models, particularly slot-based architectures, have shown great promise in decomposing complex scenes. However, their reliance on reconstruction-based training creates a fundamental conflict between the sharp, high-frequency attention maps of the encoder and the spatially consistent but blurry reconstruction maps of the decoder. We identify that this discrepancy gives rise to a vicious cycle: the noisy feature map from the encoder forces the decoder to average over possibilities and produce even blurrier outputs, while the gradient computed from blurry reconstruction maps lacks high-frequency details necessary to supervise encoder features. To break this cycle, we introduce Synergistic Representation Learning (SRL) that establishes a virtuous cycle where the encoder and decoder mutually refine one another. SRL leverages the encoder's sharpness to deblur the semantic boundary within the decoder output, while exploiting the decoder's spatial consistency to denoise the encoder's features. This mutual refinement process is stabilized by a warm-up phase with a slot regularization objective that initially allocates distinct entities per slot. By bridging the representational gap between the encoder and decoder, SRL achieves state-of-the-art results on video object-centric learning benchmarks. Codes are available at https://github.com/hynnsk/SRL.

视频理解无监督学习对象中心协同学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。