用图结构提升CT重建模型泛化能力,参数少、速度快、效果好。
Improving the Generalisation of Learned Reconstruction Frameworks
- 构建图结构表示CT数据与几何关系,结合图卷积与网格卷积。
- 在稀疏视角等未见场景下表现更优,参数仅为CNN的几分之一。
- 适合需要跨场景泛化的医学影像重建任务。
在图像逆问题中,确保数据驱动方法的泛化能力至关重要,因为神经网络需在不同数据集和采集几何条件下均表现良好。在X射线计算机断层扫描(CT)中,卷积神经网络(CNN)常用于滤波投影数据,但其基于网格的卷积操作不适用于本质上位于线性流形上的原始数据(sinogram),导致模型对几何信息无感,需大量参数从数据中推断测量间关系。本文提出双重贡献:首先,构建图数据结构表示圆形及锥束几何下的采集方式与数据;其次,提出混合架构GLM,融合图卷积与网格卷积处理断层数据。实验表明,尽管参数量仅为CNN的极少部分,GLM在结构相似性和峰值信噪比上均优于CNN,且训练时间与内存占用显著降低,内存需求增长更平缓。关键在于,模型在未见过的几何变化下(如仅用全采样数据训练却测试于稀疏视角数据)仍表现出强泛化能力。
原文摘要 · Abstract (English)
Ensuring proper generalization is a critical challenge in applying data-driven methods for solving inverse problems in imaging, as neural networks reconstructing an image must perform well across varied datasets and acquisition geometries. In X-ray Computed Tomography (CT), convolutional neural networks (CNNs) are widely used to filter the projection data but are ill-suited for this task as they apply grid-based convolutions to the sinogram, which inherently lies on a line manifold, not a regular grid. The CNNs, unaware of the geometry, are implicitly tied to it and require an excessive amount of parameters as they must infer the relations between measurements from the data rather than from prior information. The contribution of this paper is twofold. First, we introduce a graph data structure to represent CT acquisition geometries and tomographic data, providing a detailed explanation of the graph's structure for circular, cone-beam geometries. Second, we propose GLM, a hybrid neural network architecture that leverages both graph and grid convolutions to process tomographic data. We demonstrate that GLM outperforms CNNs when performance is quantified in terms of structural similarity and peak signal-to-noise ratio, despite the fact that GLM uses only a fraction of the trainable parameters. Compared to CNNs, GLM also requires significantly less training time and memory, and its memory requirements scale better. Crucially, GLM demonstrates robust generalization to unseen variations in the acquisition geometry, like when training only on fully sampled CT data and then testing on sparse-view CT data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。