arXiv:2511.01610cs.CVcs.AI2025-11被引 2

DINO-MX整合多代自监督学习技术,灵活高效训练视觉模型。

DINO-MX: A Modular & Flexible Framework for Self-Supervised Learning

  • 模块化配置框架,兼容多种视觉架构与训练策略
  • 在多数据集上表现媲美先进模型,计算成本显著降低
  • 支持多模态图像与可解释性工具,适合研究与实际部署

视觉基础模型(VFMs)通过自监督方法推动了表征学习的发展。然而,现有训练流程往往缺乏灵活性、局限于特定领域或计算开销高,限制了其在不同领域和资源环境下的应用。DINO-MX 是一个模块化且可扩展的训练框架,将 DINO、DINOv2 与 DINOv3 的核心思想统一于配置驱动的系统中。它支持多种基于 Transformer 的架构,并完全兼容 Hugging Face 生态。框架包含低秩适应(LoRA)、层冻结、知识蒸馏等多种训练策略,同时支持通过分布式数据并行(DDP)和全分片数据并行(FSDP)进行分布式训练。DINO-MX 可处理自然图像及专业数据类型,包括单通道与多通道图像。在多样数据集上的实验表明,DINO-MX 在保持竞争力表现的同时,显著降低了计算成本。此外,该框架提供可解释性工具和标签引导的数据增强方法,在无需额外检测或分割头的情况下提升注意力定位能力。DINO-MX 为自监督视觉模型的研发、适配与基准测试提供了可复现、可扩展的基础平台,适用于各类研究与真实应用场景。

原文摘要 · Abstract (English)

Vision Foundation Models (VFMs) have advanced representation learning through self-supervised methods. However, existing training pipelines are often inflexible, domain-specific, or computationally expensive, which limits their usability across different domains and resource settings. DINO-MX is a modular and extensible training framework that combines the core principles of DINO, DINOv2 and DINOv3 within a unified configuration-driven system. It supports a variety of transformer-based architectures and is fully compatible with the Hugging Face ecosystem. The framework includes multiple training strategies such as low-rank adaptation (LoRA), layer freezing, and knowledge distillation, along with support for distributed training through both Distributed Data Parallel (DDP) and Fully Sharded Data Parallel (FSDP). DINO-MX is designed to work with both natural and specialized data types, including single- and multi-channel images. Experimental results on diverse datasets show that DINO-MX achieves competitive performance while significantly reducing computational costs. Additionally, it offers interpretability tools and a label-guided data augmentation method that improves attention-based localization without the need for extra detection or segmentation heads. DINO-MX provides a reproducible and scalable foundation for developing, adapting, and benchmarking self-supervised vision models across a range of research and real-world applications.

自监督学习视觉模型模块化框架Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。