用CNN快速准确识别电镜图像中的DNA折纸结构连接数
DNA Origami Nanostructures Observed in Transmission Electron Microscopy Images can be Characterized through Convolutional Neural Networks
- 用分子模拟数据预训练CNN,再用少量实验图像微调
- 微调后VGG16在146张电镜图上识别准确率最高
- 适合需要快速分析大量电镜图像的研究者
人工智能模型在加速材料设计中日益重要。本文证明卷积神经网络(CNN)可有效表征用于程序化自组装的DNA折纸纳米结构,该技术在生物医学等领域有广泛应用。我们对比了9种CNN模型——AlexNet、GoogLeNet、VGG16、VGG19、ResNet18、ResNet34、ResNet50、ResNet101和ResNet152——在透射电子显微镜(TEM)图像中识别DNA折纸结构连接数的表现。首先,使用720张由粗粒度分子动力学(CG MD)模拟生成的图像对模型进行预训练;随后,在包含146张实验TEM图像的小数据集上进行微调。所有模型计算时间相近,但模型大小与性能各异。利用20张测试MD图像验证,预训练模型中以ResNet50和VGG16准确率最高;微调后,VGG16在测试TEM图像上表现最佳。因此得出结论:经微调的VGG16模型能快速准确表征大尺度TEM图像中的纳米结构连接数。
原文摘要 · Abstract (English)
Artificial intelligence (AI) models remain an emerging strategy to accelerate materials design and development. We demonstrate that convolutional neural network (CNN) models can characterize DNA origami nanostructures employed in programmable self-assembling, which is important in many applications such as in biomedicine. Specifically, we benchmark the performance of 9 CNN models -- viz. AlexNet, GoogLeNet, VGG16, VGG19, ResNet18, ResNet34, ResNet50, ResNet101, and ResNet152 -- to characterize the ligation number of DNA origami nanostructures in transmission electron microscopy (TEM) images. We first pre-train CNN models using a large image dataset of 720 images from our coarse-grained (CG) molecular dynamics (MD) simulations. Then, we fine-tune the pre-trained CNN models, using a small experimental TEM dataset with 146 TEM images. All CNN models were found to have similar computational time requirements, while their model sizes and performances are different. We use 20 test MD images to demonstrate that among all of the pre-trained CNN models ResNet50 and VGG16 have the highest and second highest accuracies. Among the fine-tuned models, VGG16 was found to have the highest agreement on the test TEM images. Thus, we conclude that fine-tuned VGG16 models can quickly characterize the ligation number of nanostructures in large TEM images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。