arXiv:2604.24909cs.LGcs.CE2026-04

用图像与采集参数对比预训练,提升低剂量电子显微图像的重建质量。

Contrastive Image-Metadata Pre-Training for Materials Transmission Electron Microscopy

论文配图:Contrastive Image-Metadata Pre-Training for Materials Transmission Electron Microscopy
图 1 · 摘自论文原文
  • 通过对比图像与七维采集参数,学习跨模态表征。
  • 在保留参数的线性探测中达到84.4%的跨模态检索准确率。
  • 适合材料科学、电子显微成像及物理信息模型研究者。

透射电子显微镜是迄今为止分辨率最高的成像工具,其瓶颈已从空间分辨率转向剂量效率。低电子束剂量可避免样品损伤,但产生噪声图像,且缺乏真实标签。自主材料实验同样面临挑战:闭环仪器需要基于采集时刻显微状态的表征。二者均需依赖图像获取方式的表征。我们发布了7,330对高角度环形暗场扫描透射电镜(HAADF-STEM)图像及其七维采集元数据,并提出对比图像-元数据预训练(CIMP),一种类似CLIP的编码器,能对齐两种模态,在预留测试集上实现84.4%的Top-1跨模态检索准确率。所有七个参数均可通过冻结视觉嵌入的线性探测器独立恢复。我们利用该嵌入构建元数据条件风格迁移模型,可对实验图像在不同采集参数下重渲染。虚拟调节低剂量图像的驻留时间和束流强度,使该模型成为物理信息引导的去噪器;在盲测用户研究中,实验显微学家在70.2%的试验中更偏好该方法,优于当前最先进的STEM图像去噪技术。

原文摘要 · Abstract (English)

The transmission electron microscope facilitates the highest-resolution imaging of any instrument ever created, and its limiting factor is no longer spatial resolution but dose efficiency. Low electron doses avoid sample damage but produce noisy images for which, unlike in classical computer vision, there is no ground truth. Autonomous materials experimentation poses a related problem, since closed-loop instruments need representations grounded in the microscope state at acquisition. Both demand representations grounded in how an image was acquired. We release 7,330 paired high-angle annular dark-field scanning-TEM (HAADF-STEM) images and their seven-dimensional acquisition metadata, and propose Contrastive Image-Metadata Pre-training (CIMP), a CLIP-style encoder that aligns the two modalities and reaches 84.4% Top-1 cross-modal retrieval on a held-out split. All seven parameters are individually recoverable from the frozen visual embedding through a linear probe, and we use the embedding to condition a metadata-conditioned style-transfer model that re-renders experimental images under different acquisition parameters. Virtually scaling dwell time and beam current of low-dose images turns this model into a physics-informed denoiser; in a blind user study, experimental microscopists prefer it over the current state-of-the-art denoiser for STEM imagery on 70.2% of trials.

电子显微对比学习去噪材料科学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。