arXiv:2501.08712cs.CVcs.AI2025-01

自监督学习让模型在变换中保持敏感,提升定位与分类精度。

Self-supervised Transformation Learning for Equivariant Representations

  • 用图像对生成变换表示,替代依赖标签的复杂变换学习
  • 7/11基准测试超越现有方法,检测任务表现突出
  • 兼容多种主模型,支持AugMix等复杂增强,适用性强

无监督表征学习已显著推动各类机器学习任务。在计算机视觉中,主流方法通过随机裁剪、色彩抖动等变换实现输入的不变性表征,使语义相同的内容在变换后仍保持一致。然而,此类方法在需要精确特征的任务(如定位或花朵分类)中性能下降。为此,近期研究引入等变表征学习以捕捉变换敏感信息。但现有方法依赖变换标签,难以处理变换间的耦合及复杂变换。本文提出自监督变换学习(STL),将变换标签替换为由图像对生成的变换表示,确保变换表示与图像无关,并学习对应等变变换,在不增加批处理复杂度的前提下提升性能。实验表明,该方法在多个分类与检测任务中表现优异,在11个基准中的7个超越现有方法,尤其在检测任务中表现突出。通过集成AugMix等先前无法使用的复杂变换,进一步提升了整体性能,体现了其适应性与鲁棒性。此外,其与多种基础模型的良好兼容性彰显了灵活性与广泛适用性。代码已公开于 https://github.com/jaemyung-u/stl。

原文摘要 · Abstract (English)

Unsupervised representation learning has significantly advanced various machine learning tasks. In the computer vision domain, state-of-the-art approaches utilize transformations like random crop and color jitter to achieve invariant representations, embedding semantically the same inputs despite transformations. However, this can degrade performance in tasks requiring precise features, such as localization or flower classification. To address this, recent research incorporates equivariant representation learning, which captures transformation-sensitive information. However, current methods depend on transformation labels and thus struggle with interdependency and complex transformations. We propose Self-supervised Transformation Learning (STL), replacing transformation labels with transformation representations derived from image pairs. The proposed method ensures transformation representation is image-invariant and learns corresponding equivariant transformations, enhancing performance without increased batch complexity. We demonstrate the approach's effectiveness across diverse classification and detection tasks, outperforming existing methods in 7 out of 11 benchmarks and excelling in detection. By integrating complex transformations like AugMix, unusable by prior equivariant methods, this approach enhances performance across tasks, underscoring its adaptability and resilience. Additionally, its compatibility with various base models highlights its flexibility and broad applicability. The code is available at https://github.com/jaemyung-u/stl.

自监督学习等变表征图像增强检测任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。