arXiv:2503.07444cs.CVcs.AI2025-03被引 1

让模型学会发现图像中细微复杂特征,避免被简单模式干扰。

Divide and Conquer Self-Supervised Learning for High-Content Imaging

  • 将图像分块后分别提取特征,再融合引导模型学习复杂模式。
  • 在医学与地理空间图像上显著提升下游任务性能。
  • 适用于各类自监督方法,无需修改原有模型结构。

自监督表示学习方法常因易学的简单模式而忽略细微或复杂的特征,这一问题在科学与工程应用中尤为严重,因复杂特征对发现与分析至关重要。为此,我们提出分割组件嵌入注册(SpliCER),一种新架构:将图像分块,从各部分提炼信息,引导模型在不牺牲简单特征学习的前提下,更有效捕捉微妙和复杂特征。SpliCER兼容任意自监督损失函数,可无缝集成至现有方法而无需修改。主要贡献包括:(i)证明现有自监督方法在复杂与简单特征共存时会学习捷径解;(ii)提出SpliCER方法,克服现有局限并实现显著的下游性能提升;(iii)验证了SpliCER在前沿医学与地理空间成像场景中的有效性。SpliCER为表示学习提供了一种强大工具,使模型能够发现可能被其他方法忽略的复杂特征。

原文摘要 · Abstract (English)

Self-supervised representation learning methods often fail to learn subtle or complex features, which can be dominated by simpler patterns which are much easier to learn. This limitation is particularly problematic in applications to science and engineering, as complex features can be critical for discovery and analysis. To address this, we introduce Split Component Embedding Registration (SpliCER), a novel architecture which splits the image into sections and distils information from each section to guide the model to learn more subtle and complex features without compromising on simpler features. SpliCER is compatible with any self-supervised loss function and can be integrated into existing methods without modification. The primary contributions of this work are as follows: i) we demonstrate that existing self-supervised methods can learn shortcut solutions when simple and complex features are both present; ii) we introduce a novel self-supervised training method, SpliCER, to overcome the limitations of existing methods, and achieve significant downstream performance improvements; iii) we demonstrate the effectiveness of SpliCER in cutting-edge medical and geospatial imaging settings. SpliCER offers a powerful new tool for representation learning, enabling models to uncover complex features which could be overlooked by other methods.

自监督学习图像分析医学影像复杂特征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。