arXiv:2604.05960cs.LG2026-04

首个用于扫描电镜图像的通用基础模型,可跨材料与成像条件迁移。

A Mixture of Experts Foundation Model for Scanning Electron Microscopy Image Analysis

  • 自监督Transformer架构预训练,学习可迁移的图像表征。
  • 无成对标注下实现模糊到清晰图像的重建,性能优于现有方法。
  • 适合材料科学领域研究者快速适配新任务,加速发现新材料。

扫描电子显微镜(SEM)在现代材料科学中不可或缺,可实现高分辨率成像,广泛应用于结构、化学及功能分析。然而,SEM成像仍受限于特定任务的模型和人工密集型采集流程,难以在多样应用中规模化。本文首次提出针对SEM图像的基础模型,在大规模多仪器、多条件科学显微图像上预训练,实现跨材料体系与成像条件的泛化能力。该模型采用自监督Transformer架构,学习丰富且可迁移的表征,支持下游任务的微调或适配。作为典型应用,我们聚焦于模糊到清晰的图像转换——自动化显微流程中的关键但未充分探索挑战。所提方法无需成对标注即可从模糊输入恢复清晰细节,并在多个评估指标上超越现有最佳技术。本工作为可适应的SEM模型开辟新范式,推动材料发现进程,弥合基础表征学习与实际成像需求之间的鸿沟。

原文摘要 · Abstract (English)

Scanning Electron Microscopy (SEM) is indispensable in modern materials science, enabling high-resolution imaging across a wide range of structural, chemical, and functional investigations. However, SEM imaging remains constrained by task-specific models and labor-intensive acquisition processes that limit its scalability across diverse applications. Here, we introduce the first foundation model for SEM images, pretrained on a large corpus of multi-instrument, multi-condition scientific micrographs, enabling generalization across diverse material systems and imaging conditions. Leveraging a self-supervised transformer architecture, our model learns rich and transferable representations that can be fine-tuned or adapted to a wide range of downstream tasks. As a compelling demonstration, we focus on defocus-to-focus image translation-an essential yet underexplored challenge in automated microscopy pipelines. Our method not only restores focused detail from defocused inputs without paired supervision but also outperforms state-of-the-art techniques across multiple evaluation metrics. This work lays the groundwork for a new class of adaptable SEM models, accelerating materials discovery by bridging foundational representation learning with real-world imaging needs.

扫描电镜基础模型自监督学习图像重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。