arXiv:2506.11283eess.IVcs.CV2025-06

用极坐标注意力网络提升冷冻电镜图像去噪,实现端到端重建。

Joint Denoising of Cryo-EM Projection Images using Polar Transformers

论文配图:Joint Denoising of Cryo-EM Projection Images using Polar Transformers
图 1 · 摘自论文原文
  • 提出极坐标变换与Transformer结合的新架构,保持旋转对称性。
  • 在低信噪比(SNR=0.02)下,均方误差降低两倍。
  • 适合需要高精度图像重建的结构生物学研究者。

许多成像模态需从随机旋转的多张噪声投影中重建未知物体。在冷冻电镜(cryo-EM)中,极低的信噪比(SNR)使得整合多图信息至关重要。现有方法或依赖人工先验,或仅在粒子识别、显微图去噪等环节使用深度学习。全端到端重建需兼顾多图信息融合与测量过程的旋转对称性。本文提出极坐标变换器(polar transformer),结合极坐标表示、Transformer与卷积注意力机制,保留旋转对称性。应用于粒子级去噪,可学习图像中判别性特征,实现最优聚类、对齐与去噪。在模拟数据上,于SNR=0.02时,均方误差(MSE)降低达2倍,为冷冻电镜及类似断层成像模态的数据驱动重建开辟新路径。

原文摘要 · Abstract (English)

Many imaging modalities involve reconstruction of unknown objects from collections of noisy projections related by random rotations. In one of these modalities, cryogenic electron microscopy (cryo-EM), the extremely low signal-to-noise ratio (SNR) makes integration of information from multiple images crucial. Existing approaches to cryo-EM processing, however, either rely on handcrafted priors or apply deep learning only on select portions of the pipeline, such as particle picking, micrograph denoising, or refinement. A fully end-to-end reconstruction approach requires a neural network architecture that integrates information from multiple images while respecting the rotational symmetry of the measurement process. In this work, we introduce the polar transformer, a new neural network architecture that combines polar representations and transformers along with a convolutional attention mechanism that preserves the rotational symmetry of the problem. We apply it to the particle-level denoising problem, where it is able to learn discriminative features in the images, enabling optimal clustering, alignment, and denoising. On simulated datasets, this achieves up to a $2\times$ reduction in mean squared error (MSE) at a signal-to-noise ratio (SNR) of $0.02$, suggesting new opportunities for data-driven approaches to reconstruction in cryo-EM and related tomographic modalities.

冷冻电镜图像去噪注意力机制结构生物学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。