arXiv:2506.17425eess.IVcs.AI2025-06被引 1

用双变压器框架提升低视角CBCT重建质量,减少伪影与辐射剂量。

Trans${^2}$-CBCT: A Dual-Transformer Framework for Sparse-View CBCT Reconstruction

  • 融合卷积与注意力机制的TransUNet模型,增强局部与全局特征提取。
  • 在六视角下比基线提升1.17 dB PSNR和0.0163 SSIM,十视角更优。
  • 引入邻域感知点变换器,强化三维空间一致性,适合医学影像重建研究者。

仅使用少量X射线投影视角的锥束计算机断层扫描(CBCT)可实现更快扫描并降低辐射剂量,但严重欠采样导致强烈伪影和空间覆盖不足。本文提出统一框架解决此问题:首先,将传统UNet/ResNet编码器替换为混合型CNN-Transformer模型TransUNet,其卷积层捕捉局部细节,自注意力层增强全局上下文;通过多尺度特征融合、每3D点查询视图特异性特征,并加入轻量级衰减预测头,构建Trans-CBCT,在六视角下于LUNA16数据集上实现1.17 dB PSNR与0.0163 SSIM的提升。其次,引入邻域感知点变换器,利用3D位置编码与k近邻注意力,增强体积一致性,使整体模型Trans²-CBCT额外获得0.63 dB PSNR与0.0117 SSIM增益。在LUNA16与ToothFairy数据集上,从六到十视角均表现稳定提升,验证了结合CNN-Transformer特征与基于点的几何推理在稀疏视角CBCT重建中的有效性。

原文摘要 · Abstract (English)

Cone-beam computed tomography (CBCT) using only a few X-ray projection views enables faster scans with lower radiation dose, but the resulting severe under-sampling causes strong artifacts and poor spatial coverage. We address these challenges in a unified framework. First, we replace conventional UNet/ResNet encoders with TransUNet, a hybrid CNN-Transformer model. Convolutional layers capture local details, while self-attention layers enhance global context. We adapt TransUNet to CBCT by combining multi-scale features, querying view-specific features per 3D point, and adding a lightweight attenuation-prediction head. This yields Trans-CBCT, which surpasses prior baselines by 1.17 dB PSNR and 0.0163 SSIM on the LUNA16 dataset with six views. Second, we introduce a neighbor-aware Point Transformer to enforce volumetric coherence. This module uses 3D positional encoding and attention over k-nearest neighbors to improve spatial consistency. The resulting model, Trans$^2$-CBCT, provides an additional gain of 0.63 dB PSNR and 0.0117 SSIM. Experiments on LUNA16 and ToothFairy show consistent gains from six to ten views, validating the effectiveness of combining CNN-Transformer features with point-based geometry reasoning for sparse-view CBCT reconstruction.

CBCT重建双变压器医学影像稀疏视角

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。