无需参考影像,仅用照片即可重建脑切片3D结构。
Reference-Free 3D Reconstruction of Brain Dissection Slabs via Learned Atlas Coordinates
- 用标准脑图谱坐标引导,从任意数量切片照片重建3D体积。
- 单张切片也能实现精准重建与配准,速度远超传统方法。
- 适合缺乏MRI或完整切片数据的研究者使用。
将神经病理学与MRI关联,有望将显微病理特征映射到活体扫描中。当前常通过脑库解剖时拍摄的切片照片构建3D重建,避免了难以获取的离体MRI。但现有方法需对应3D参考(如离体MRI或结构光扫描表面)或完整切片堆栈,应用受限。本文提出RefFree,一种无需外部参考的切片照片3D重建方法。该方法利用预测的标准化图谱空间(MNI)3D坐标作为引导,对任意切片集(包括单张)进行一致的3D体积重建。为支持该流程,我们训练了一个图谱坐标预测网络,基于数字化切片的3D MRI生成的合成照片(含随机外观)进行训练,以增强泛化能力。作为副产品,RefFree可将图谱中的信息(如解剖标签)传播至单张照片,即使未完成重建。在模拟与真实数据上的实验表明,当所有切片可用时,RefFree性能接近经典方法,但速度显著提升;且对部分切片或单张切片也能实现准确重建与配准。代码已开源:https://github.com/lintian-a/reffree。
原文摘要 · Abstract (English)
Correlation of neuropathology with MRI has the potential to transfer microscopic signatures of pathology to in vivo scans. There is increasing interest in building these correlations from 3D reconstructed stacks of slab photographs, which are routinely taken during dissection at brain banks. These photographs bypass the need for ex vivo MRI, which is not widely accessible. However, existing methods either require a corresponding 3D reference (e.g., an ex vivo MRI scans, or a brain surface acquired with a structured light scanner) or a full stack of brain slabs, which severely limits applicability. Here we propose RefFree, a 3D reconstruction method for dissection photographs that does not require an external reference. RefFree coherently reconstructs a 3D volume for an arbitrary set of slabs (including a single slab) using predicted 3D coordinates in the standard atlas space (MNI) as guidance. To support RefFree's pipeline, we train an atlas coordinate prediction network that estimates the coordinate map from a 2D photograph, using synthetic photographs generated from digitally sliced 3D MRI data with randomized appearance for enhanced generalization. As a by-product, RefFree can propagate information (e.g., anatomical labels) from atlas space to one single photograph even without reconstruction. Experiments on simulated and real data show that, when all slabs are available, RefFree achieves performance comparable to existing classical methods but at substantially higher speed. Moreover, RefFree yields accurate reconstruction and registration for partial stacks or even a single slab. Our code is available at https://github.com/lintian-a/reffree.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。