arXiv:2512.06684cs.CV2025-12中稿 · CVPR

用动态高斯建模实现电子显微镜切片的连续三维重建

EMGauss: Continuous Slice-to-3D Reconstruction via Dynamic Gaussian Modeling in Volume Electron Microscopy

  • 将切片重建视为动态高斯点云的时间演化过程
  • 在数据稀疏时仍保持高质量,优于扩散与GAN方法
  • 无需大规模预训练,适合生物成像等多领域应用

体式电子显微镜(vEM)可实现纳米级3D生物结构成像,但受限于采集权衡,常产生轴向分辨率低的各向异性数据。现有深度学习方法依赖横向先验恢复各向同性,但在形态各向异性结构上失效。本文提出EMGauss,一种基于高斯点云动态演化的通用3D重建框架,将切片序列建模为时间演化的2D高斯点云。为提升数据稀疏区域的保真度,引入教师-学生自举机制,利用未观测切片的高置信度预测作为伪监督信号。相比扩散模型与GAN方法,EMGauss显著提升插值质量,支持连续切片生成,且无需大规模预训练。该方法不仅适用于vEM,还可推广至多种成像领域。

原文摘要 · Abstract (English)

Volume electron microscopy (vEM) enables nanoscale 3D imaging of biological structures but remains constrained by acquisition trade-offs, leading to anisotropic volumes with limited axial resolution. Existing deep learning methods seek to restore isotropy by leveraging lateral priors, yet their assumptions break down for morphologically anisotropic structures. We present EMGauss, a general framework for 3D reconstruction from planar scanned 2D slices with applications in vEM, which circumvents the inherent limitations of isotropy-based approaches. Our key innovation is to reframe slice-to-3D reconstruction as a 3D dynamic scene rendering problem based on Gaussian splatting, where the progression of axial slices is modeled as the temporal evolution of 2D Gaussian point clouds. To enhance fidelity in data-sparse regimes, we incorporate a Teacher-Student bootstrapping mechanism that uses high-confidence predictions on unobserved slices as pseudo-supervisory signals. Compared with diffusion- and GAN-based reconstruction methods, EMGauss substantially improves interpolation quality, enables continuous slice synthesis, and eliminates the need for large-scale pretraining. Beyond vEM, it potentially provides a generalizable slice-to-3D solution across diverse imaging domains.

三维重建电子显微镜高斯建模图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。