arXiv:2501.03153cs.CVphysics.data-an2025-01被引 2

为低信噪比电镜视频开发实时分割模型,实现纳米颗粒动态精准追踪

SAM-EM: Real-Time Segmentation for Automated Liquid Phase Transmission Electron Microscopy

  • 基于SAM2全量微调,适配液相电镜噪声数据
  • 在4.66万帧合成数据上提升掩码质量与轨迹稳定性
  • 支持从分割到统计分析的全流程,适合材料动态研究

液相透射电子显微镜(LPTEM)视频因缺乏稳健的分割框架,难以可靠提取粒子轨迹,阻碍了定量分析及材料表征与设计的关联。为此,我们提出电子显微领域自适应基础模型SAM-EM,其基于Segment Anything Model 2(SAM~2),通过在46,600张精心标注的合成视频帧上进行全模型微调,显著提升了掩码质量与时间身份一致性,优于零样本SAM~2及现有基线方法。除分割外,SAM-EM集成粒子追踪与统计分析工具,包括均方位移和粒子位移分布分析,构建端到端的纳米尺度动力学解析框架。关键在于,全微调使SAM-EM在低信噪比条件下仍具鲁棒性,例如液态样品厚度增加时。该模型建立可靠分析流程,将LPTEM转化为可量化的单粒子追踪平台,加速其在数据驱动材料发现与设计中的应用。项目页面:github.com/JamaliLab/SAM-EM。

原文摘要 · Abstract (English)

The absence of robust segmentation frameworks for noisy liquid phase transmission electron microscopy (LPTEM) videos prevents reliable extraction of particle trajectories, creating a major barrier to quantitative analysis and to connecting observed dynamics with materials characterization and design. To address this challenge, we present Segment Anything Model for Electron Microscopy (SAM-EM), a domain-adapted foundation model that unifies segmentation, tracking, and statistical analysis for LPTEM data. Built on Segment Anything Model 2 (SAM~2), SAM-EM is derived through full-model fine-tuning on 46,600 curated LPTEM synthetic video frames, substantially improving mask quality and temporal identity stability compared to zero-shot SAM~2 and existing baselines. Beyond segmentation, SAM-EM integrates particle tracking with statistical tools, including mean-squared displacement and particle displacement distribution analysis, providing an end-to-end framework for extracting and interpreting nanoscale dynamics. Crucially, full fine-tuning allows SAM-EM to remain robust under low signal-to-noise conditions, such as those caused by increased liquid sample thickness in LPTEM experiments. By establishing a reliable analysis pipeline, SAM-EM transforms LPTEM into a quantitative single-particle tracking platform and accelerates its integration into data-driven materials discovery and design. Project page: \href{https://github.com/JamaliLab/SAM-EM}{github.com/JamaliLab/SAM-EM}.

图像分割电子显微镜单粒子追踪纳米材料

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。