arXiv:2607.28868cs.CV2026-07

为科学成像设计符合物理规律的自监督增强方法,显著提升模型性能。

Physics-Aligned Self-Supervised Learning for Scientific Imaging

论文配图:Physics-Aligned Self-Supervised Learning for Scientific Imaging
图 1 · 摘自论文原文
  • 基于测量对称性和采集约束设计物理一致的增强策略
  • 在五种自监督模型上实现跨视角一致性任务性能显著提升
  • 适用于电子显微、医学等依赖物理过程的成像领域

数据增强定义了自监督学习(SSL)所学习的不变性。标准增强流程针对自然图像设计,但科学成像受物理测量过程支配,具有独特的对称性与采集约束。强制违背这些约束的不变性会扭曲学习表征并限制下游性能。当前科研人员在新成像模态中缺乏有效指导,往往直接迁移自然图像的增强方案。本文提出一种原则性强、可复现的科学SSL增强设计流程:将物理对齐增强集形式化为测量一致对称性与采集驱动扰动的并集,并提供无需标签的实用工作流——枚举候选、由测量算子标注、通过表征几何诊断验证、单因素消融确认。该方法应用于实空间电子显微与倒易空间4D-STEM衍射,评估了五种SSL范式(DINOv2, SimCLR, MAE, VICRegL, I-JEPA)在分类与晶体取向回归任务上的表现。物理对齐增强显著提升了依赖跨视图一致性的任务性能,降低测地线误差,增强对真实采集变异(探测器增益、分辨率损失)的鲁棒性,并系统改变表征几何结构。尽管实验基于电子显微,该流程具备模态无关性,可推广至医疗、遥感等测量驱动领域。结果表明,增强设计是科学自监督学习中可控且关键的归纳偏置来源。

原文摘要 · Abstract (English)

Data augmentations define the invariances learned by self-supervised learning (SSL). Standard augmentation pipelines were designed for natural images, yet scientific imaging modalities are governed by physical measurement processes with distinct symmetry and acquisition constraints. Enforcing invariances that contradict these constraints can distort learned representations and limit downstream performance, but practitioners moving from machine learning into a new scientific modality currently have little guidance beyond transferring natural-image pipelines unexamined. We address this gap with a principled, reproducible procedure for augmentation design in scientific SSL: we formalise the physics-aligned augmentation set as a union of measurement-consistent symmetries and acquisition-driven perturbations, and we give a concrete, largely label-free workflow---enumerate candidates, label each by the measurement operator, validate with representation-geometry diagnostics, and confirm by single-factor ablation---for selecting them. We instantiate the procedure for real-space electron microscopy and reciprocal-space 4D-STEM diffraction, and evaluate it across five SSL paradigms (DINOv2, SimCLR, MAE, VICRegL, I-JEPA) on classification and crystal-orientation regression. Physics-aligned augmentations substantially improve downstream performance for objectives relying on cross-view consistency, reduce geodesic error and improve robustness under realistic acquisition variability (detector gain, resolution loss), and systematically reshape representation geometry. While our experiments use electron microscopy, the procedure is modality-agnostic and applies to other measurement-driven domains such as medical and remote-sensing imaging. These results position augmentation design as a primary, and controllable, source of inductive bias in scientific self-supervised learning.

自监督学习科学成像物理建模图像增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。