用扩散模型做先验,从不完整数据中重建3D结构
Diffusion priors for Bayesian 3D reconstruction from incomplete measurements
- 用扩散模型作为3D结构先验,结合贝叶斯框架建模
- 仅需稀疏、低分辨、部分数据即可实现高质量3D重建
- 适合结构生物学中冷冻电镜数据不足的场景
许多逆问题本质上是病态的,需借助先验信息限制可接受模型的范围。贝叶斯方法将此类信息编码为先验分布,施加稀疏性、非负性或平滑性等通用性质。然而,对于图像、图或三维(3D)物体等复杂结构模型,通用先验往往偏向于与真实世界观测差异较大的模型。本文探索在贝叶斯框架中使用扩散模型作为先验,结合实验数据。我们以3D点云表示家用物品或由蛋白质和核酸构成的生物分子复合物。训练扩散模型生成中等分辨率的粗粒度3D结构,并将其与不完整且含噪声的实验数据融合。为展示该方法的有效性,聚焦于从冷冻电子显微镜(cryo-EM)图像中重构生物分子组装体这一重要逆问题。结果表明,结合扩散模型先验的后验采样,可在极稀疏、低分辨率及部分观测条件下实现3D重建。
原文摘要 · Abstract (English)
Many inverse problems are ill-posed and need to be complemented by prior information that restricts the class of admissible models. Bayesian approaches encode this information as prior distributions that impose generic properties on the model such as sparsity, non-negativity or smoothness. However, in case of complex structured models such as images, graphs or three-dimensional (3D) objects,generic prior distributions tend to favor models that differ largely from those observed in the real world. Here we explore the use of diffusion models as priors that are combined with experimental data within a Bayesian framework. We use 3D point clouds to represent 3D objects such as household items or biomolecular complexes formed from proteins and nucleic acids. We train diffusion models that generate coarse-grained 3D structures at a medium resolution and integrate these with incomplete and noisy experimental data. To demonstrate the power of our approach, we focus on the reconstruction of biomolecular assemblies from cryo-electron microscopy (cryo-EM) images, which is an important inverse problem in structural biology. We find that posterior sampling with diffusion model priors allows for 3D reconstruction from very sparse, low-resolution and partial observations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。