改进神经辐射场的CBCT重建,解决训练不稳定问题
NeRF-based CBCT Reconstruction needs Normalization and Initialization
- 引入归一化哈希编码器,提升特征一致性
- 提出映射一致性初始化,加速收敛并提升图像质量
- 在128例不同数据集上验证,适用于医学影像重建
锥束计算机断层成像(CBCT)广泛应用于医疗影像,但因投影数量和强度有限,重建属于病态问题,易产生严重伪影。基于NeRF的方法在此任务中表现优异,但其核心组件——哈希编码器与神经网络之间存在局部-全局训练不匹配:每步训练仅使用哈希编码器的部分参数(局部稀疏),而神经网络始终参与全部参数更新(全局密集)。导致各步生成的哈希特征高度错位,这些不一致特征被输入神经网络,引发重复的不一致全局更新,造成训练不稳定、收敛缓慢及重建质量下降。为此,本文提出归一化哈希编码器以增强特征一致性,并设计映射一致性初始化(MCI)策略,利用预训练模型的全局映射特性初始化神经网络。该初始化使早期训练更稳定,实现更快收敛与更好重建效果。方法简洁有效,仅需少量代码修改,在4个不同数据集共128例扫描(涵盖7种解剖区域)上显著提升训练效率与重建质量。
原文摘要 · Abstract (English)
Cone Beam Computed Tomography (CBCT) is widely used in medical imaging. However, the limited number and intensity of X-ray projections make reconstruction an ill-posed problem with severe artifacts. NeRF-based methods have achieved great success in this task. However, they suffer from a local-global training mismatch between their two key components: the hash encoder and the neural network. Specifically, in each training step, only a subset of the hash encoder's parameters is used (local sparse), whereas all parameters in the neural network participate (global dense). Consequently, hash features generated in each step are highly misaligned, as they come from different subsets of the hash encoder. These misalignments from different training steps are then fed into the neural network, causing repeated inconsistent global updates in training, which leads to unstable training, slower convergence, and degraded reconstruction quality. Aiming to alleviate the impact of this local-global optimization mismatch, we introduce a Normalized Hash Encoder, which enhances feature consistency and mitigates the mismatch. Additionally, we propose a Mapping Consistency Initialization(MCI) strategy that initializes the neural network before training by leveraging the global mapping property from a well-trained model. The initialized neural network exhibits improved stability during early training, enabling faster convergence and enhanced reconstruction performance. Our method is simple yet effective, requiring only a few lines of code while substantially improving training efficiency on 128 CT cases collected from 4 different datasets, covering 7 distinct anatomical regions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。