用3D扩散模型重建低角度电子断层图像,无需真实标注数据。
Limited-Angle Tomography Reconstruction via Projector Guided 3D Diffusion
- 基于仿真数据训练3D扩散模型,学习真实结构先验。
- 在8度窄角度下仍可精准重建,2度增量采样无须重训。
- 直接在体积上操作,自动保持切片一致性,适合微观结构重建。
有限角度电子断层成像旨在从透射电镜(TEM)在有限倾角范围内的二维投影中重建三维结构,但受限于缺失楔形问题,常引发严重伪影。深度学习虽能缓解此问题,却通常需要大量带真实三维标签的高质量训练数据,而这类数据在电子显微学中难以获取。为此,我们提出TEMDiff,一种基于3D扩散的迭代重建框架。该方法利用现成的体数据(FIB-SEM)通过模拟器映射为TEM倾角序列进行训练,使模型在无需干净TEM真值的情况下学习真实结构先验。由于直接作用于3D体积,TEMDiff隐式保证了切片间一致性,无需额外正则化。在有限角度覆盖的模拟数据集上,其重建质量优于现有最优方法。进一步实验表明,训练好的TEMDiff模型对不同条件下的真实TEM倾角具有强泛化能力,可在仅8度倾角、2度增量条件下恢复准确结构,且无需重新训练或微调。
原文摘要 · Abstract (English)
Limited-angle electron tomography aims to reconstruct 3D shapes from 2D projections of Transmission Electron Microscopy (TEM) within a restricted range and number of tilting angles, but it suffers from the missing-wedge problem that causes severe reconstruction artifacts. Deep learning approaches have shown promising results in alleviating these artifacts, yet they typically require large high-quality training datasets with known 3D ground truth which are difficult to obtain in electron microscopy. To address these challenges, we propose TEMDiff, a novel 3D diffusion-based iterative reconstruction framework. Our method is trained on readily available volumetric FIB-SEM data using a simulator that maps them to TEM tilt series, enabling the model to learn realistic structural priors without requiring clean TEM ground truth. By operating directly on 3D volumes, TEMDiff implicitly enforces consistency across slices without the need for additional regularization. On simulated electron tomography datasets with limited angular coverage, TEMDiff outperforms state-of-the-art methods in reconstruction quality. We further demonstrate that a trained TEMDiff model generalizes well to real-world TEM tilts obtained under different conditions and can recover accurate structures from tilt ranges as narrow as 8 degrees, with 2-degree increments, without any retraining or fine-tuning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。