用零样本方法实现2D材料全自动精准表征,媲美专家水平。
Zero-shot Autonomous Microscopy for Scalable and Intelligent Characterization of 2D Materials
- 融合视觉大模型与语言模型,通过提示工程实现全流程自主控制。
- 单层MoS2识别准确率达99.7%,可检测人眼难辨的晶界裂纹。
- 无需训练即可适应不同制备方式和成像条件,适用多种2D材料。
原子尺度材料表征传统上依赖需数月到数年培训的人类专家。即使对训练有素的操作员而言,在分析新发现的二维(2D)材料时仍面临准确性和可靠性挑战。这一瓶颈推动了无需大规模训练数据的全自主实验系统的需求。本文提出ATOMIC(Autonomous Technology for Optical Microscopy & Intelligent Characterization),一个端到端框架,整合基础模型以实现2D材料的完全自主、零样本表征。系统结合视觉基础模型(如Segment Anything Model)、大语言模型(如ChatGPT)、无监督聚类与拓扑分析,通过提示工程自动完成显微镜控制、样品扫描、图像分割与智能分析,无需额外训练。在典型MoS2样品分析中,单层识别准确率达99.7%,与人类专家相当;还能检测人眼难以识别的晶界裂纹。系统在焦距偏差、色温波动和曝光变化等条件下仍保持高精度。适用于广泛常见的2D材料——包括石墨烯、MoS2、WSe2、SnSe——无论其通过化学气相沉积或机械剥离制备。本工作实现了基础模型在自主分析中的落地,建立了一种可扩展、数据高效的新范式,从根本上变革纳米材料研究方式。
原文摘要 · Abstract (English)
Characterization of atomic-scale materials traditionally requires human experts with months to years of specialized training. Even for trained human operators, accurate and reliable characterization remains challenging when examining newly discovered materials such as two-dimensional (2D) structures. This bottleneck drives demand for fully autonomous experimentation systems capable of comprehending research objectives without requiring large training datasets. In this work, we present ATOMIC (Autonomous Technology for Optical Microscopy & Intelligent Characterization), an end-to-end framework that integrates foundation models to enable fully autonomous, zero-shot characterization of 2D materials. Our system integrates the vision foundation model (i.e., Segment Anything Model), large language models (i.e., ChatGPT), unsupervised clustering, and topological analysis to automate microscope control, sample scanning, image segmentation, and intelligent analysis through prompt engineering, eliminating the need for additional training. When analyzing typical MoS2 samples, our approach achieves 99.7% segmentation accuracy for single layer identification, which is equivalent to that of human experts. In addition, the integrated model is able to detect grain boundary slits that are challenging to identify with human eyes. Furthermore, the system retains robust accuracy despite variable conditions including defocus, color temperature fluctuations, and exposure variations. It is applicable to a broad spectrum of common 2D materials-including graphene, MoS2, WSe2, SnSe-regardless of whether they were fabricated via chemical vapor deposition or mechanical exfoliation. This work represents the implementation of foundation models to achieve autonomous analysis, establishing a scalable and data-efficient characterization paradigm that fundamentally transforms the approach to nanoscale materials research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。