arXiv:2512.15715cs.CV2025-12被引 9

用像素级自监督训练模型,性能媲美主流方法。

In Pursuit of Pixel Supervision for Visual Pre-training

  • 基于掩码自编码器增强,直接在像素空间学习
  • 20亿图像预训练,多任务表现超越或持平DINOv3
  • 适合追求简单高效且对下游任务泛化强的研究者

像素是视觉信息的基本单元,涵盖从低层属性到高层概念的丰富信息。自编码器是基于像素学习表征的经典范式。本文证明,基于自编码器的自监督学习至今仍具竞争力,能生成强大的下游任务表征,且具备简洁、稳定和高效的优势。提出的模型Pixio是对掩码自编码器(MAE)的改进,采用更具挑战性的预训练任务和更强大的架构,在20亿张网络爬取图像上进行训练,并结合最小人工干预的自优化策略。Pixio在多个真实场景下游任务中表现优异,包括单目深度估计(如Depth Anything)、前馈式3D重建(即MapAnything)、语义分割和机器人学习,性能与在相似规模下训练的DINOv3相当或更优。结果表明,像素空间自监督学习可作为潜在替代方案,与隐空间方法形成互补。

原文摘要 · Abstract (English)

At the most basic level, pixels are the source of the visual information through which we perceive the world. Pixels contain information at all levels, ranging from low-level attributes to high-level concepts. Autoencoders represent a classical and long-standing paradigm for learning representations from pixels or other raw inputs. In this work, we demonstrate that autoencoder-based self-supervised learning remains competitive today and can produce strong representations for downstream tasks, while remaining simple, stable, and efficient. Our model, codenamed "Pixio", is an enhanced masked autoencoder (MAE) with more challenging pre-training tasks and more capable architectures. The model is trained on 2B web-crawled images with a self-curation strategy with minimal human curation. Pixio performs competitively across a wide range of downstream tasks in the wild, including monocular depth estimation (e.g., Depth Anything), feed-forward 3D reconstruction (i.e., MapAnything), semantic segmentation, and robot learning, outperforming or matching DINOv3 trained at similar scales. Our results suggest that pixel-space self-supervised learning can serve as a promising alternative and a complement to latent-space approaches.

自监督学习像素空间图像预训练掩码自编码器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。