arXiv:2508.04929eess.IVcs.CV2025-08

用高斯点云重建冷冻电镜分子结构,无需初始模型。

CryoSplat: Gaussian Splatting for Cryo-EM Homogeneous Reconstruction

  • 将高斯点云渲染引入冷冻电镜重建,实现从原始图像直接恢复3D密度
  • 提出正交投影感知的高斯点云方法,支持随机初始化和稳定收敛
  • 适配冷冻电镜成像物理,可独立运行于无原子模型的全流程

冷冻电镜(cryo-EM)是结构生物学中获取近原子分辨率大分子结构的关键技术。单颗粒冷冻电镜的核心计算任务是从未知取向的噪声2D投影中重建分子的3D电势分布。高斯混合模型(GMM)提供连续、紧凑且具有物理可解释性的分子密度表示,近年来在冷冻电镜重建中受到关注。然而,现有方法依赖外部共识图或原子模型进行初始化,限制了其在自包含流程中的应用。与此同时,可微渲染技术如高斯点云(Gaussian splatting)在体素表示中展现出卓越的可扩展性和效率,为基于GMM的冷冻电镜重建提供了自然适配方案。然而,现成的高斯点云方法专为真实感视图合成设计,与冷冻电镜在成像物理、重建目标和坐标系统上存在不匹配。为此,我们提出cryoSplat,一种将高斯点云与冷冻电镜成像物理相结合的GMM方法。特别地,我们设计了正交投影感知的高斯点云,包含视图相关归一化项及针对冷冻电镜成像定制的FFT对齐坐标系。这些创新使cryoSplat能够仅凭随机初始化,直接从原始冷冻电镜粒子图像实现稳定高效的同质重建。在真实数据集上的实验验证了其优于代表性基线方法的有效性与鲁棒性。代码将发布于https://github.com/Chen-Suyi/cryosplat。

原文摘要 · Abstract (English)

As a critical modality for structural biology, cryogenic electron microscopy (cryo-EM) facilitates the determination of macromolecular structures at near-atomic resolution. The core computational task in single-particle cryo-EM is to reconstruct the 3D electrostatic potential of a molecule from noisy 2D projections acquired at unknown orientations. Gaussian mixture models (GMMs) provide a continuous, compact, and physically interpretable representation for molecular density and have recently gained interest in cryo-EM reconstruction. However, existing methods rely on external consensus maps or atomic models for initialization, limiting their use in self-contained pipelines. In parallel, differentiable rendering techniques such as Gaussian splatting have demonstrated remarkable scalability and efficiency for volumetric representations, suggesting a natural fit for GMM-based cryo-EM reconstruction. However, off-the-shelf Gaussian splatting methods are designed for photorealistic view synthesis and remain incompatible with cryo-EM due to mismatches in the image formation physics, reconstruction objectives, and coordinate systems. Addressing these issues, we propose cryoSplat, a GMM-based method that integrates Gaussian splatting with the physics of cryo-EM image formation. In particular, we develop an orthogonal projection-aware Gaussian splatting, with adaptations such as a view-dependent normalization term and FFT-aligned coordinate system tailored for cryo-EM imaging. These innovations enable stable and efficient homogeneous reconstruction directly from raw cryo-EM particle images using random initialization. Experimental results on real datasets validate the effectiveness and robustness of cryoSplat over representative baselines. The code will be released at https://github.com/Chen-Suyi/cryosplat.

冷冻电镜高斯点云三维重建结构生物学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。