arXiv:2607.11196cs.CV2026-07

无需预训练生成模型,直接在视觉特征空间中实现高效对象中心学习。

Slot-RAE: Streamlining Object-Centric Learning via Direct Representation Auto-Encoders

论文配图:Slot-RAE: Streamlining Object-Centric Learning via Direct Representation Auto-Encoders
图 1 · 摘自论文原文
  • 在冻结的视觉基础模型特征空间中,用DiT解码器进行特征空间扩散
  • 零样本组合性与重建质量达顶尖水平,推理速度更快
  • 适合追求高效、端到端对象理解的科研与工业应用

将对象中心模型用于真实场景理解通常需要复杂的流水线来实现鲁棒的场景分解和高保真生成。近年来基于扩散的方法提升了视觉质量,但几乎都依赖于重型预训练生成先验(如Stable Diffusion)和外部VAE隐空间。本文提出Slot-RAE,一种更简洁、完全集成的框架,直接在视觉基础模型(如DINOv3)的连续语义特征空间中运行。Slot-RAE采用基于扩散的Transformer(DiT)解码器和表示对齐(REPA)头,在冻结的VFM特征空间中从头训练生成核心(槽注意力与DiT),无需VAE瓶颈和任务无关的生成预训练。在COCO数据集上的实验表明,尽管架构简单,Slot-RAE实现了最先进性能:具备可比的无监督对象发现能力、更高保真度图像重建,以及稳健的零样本组合性,同时显著优于现有对象中心潜变量扩散模型的速度与计算效率。

原文摘要 · Abstract (English)

Deploying object-centric models for real-world scene understanding typically requires complex pipelines to achieve both robust scene decomposition and high-fidelity generation. Recent diffusion-based approaches have improved visual quality, but they almost universally rely on heavy, pretrained generative priors (e.g., Stable Diffusion) and external VAE latent spaces. In this paper, we propose Slot-RAE, a much simpler, fully integrated framework that operates directly within the continuous semantic feature space of visual foundation models (e.g., DINOv3). Slot-RAE employs a feature-space diffusion process using a Diffusion Transformer (DiT) decoder and a Representation Alignment (REPA) head. Unlike existing diffusion-based objectcentric methods that rely heavily on subsidized text-toimage priors, the generative core of Slot-RAE (Slot Attention and the DiT) is trained from scratch within the frozen VFM feature space. This eliminates the need for VAE bottlenecks and task-agnostic generative pre-training. Experiments on the COCO dataset demonstrate that despite its architectural simplicity, Slot-RAE achieves state-of-the-art results. It delivers comparable unsupervised object discovery, higher-fidelity image reconstruction, and robust zero-shot compositionality, all while being significantly faster and more computationally efficient than existing object-centric latent diffusion models.

对象中心扩散模型特征空间高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。