用稀疏时间步加速3D医学图像增强,保留细节还快10倍。
Structure-Adaptive Sparse Diffusion in Voxel Space for 3D Medical Image Enhancement

- 只在稀疏时间步训练采样,减少计算负担。
- 在CT/PET/MRI数据上实现顶尖去噪与超分辨效果。
- 结构自适应模块让不同部位的修复更精准,适合临床影像处理。
三维医学图像增强(包括去噪与超分辨率)对CT、PET和MRI的临床诊断至关重要。尽管扩散模型在2D医学图像中表现优异,但将其扩展到高分辨率3D体数据仍因高维数据上的长扩散轨迹而计算成本过高。我们观察到,在条件增强任务中,退化输入中的强解剖先验使得密集的时间步设置大多冗余。为此,我们提出一种稀疏体素空间扩散框架,仅在均匀下采样的时间步上进行训练与采样。网络直接在数据流形上预测干净图像,并在速度空间中监督以实现稳定的梯度缩放。轻量级结构感知轨迹调制(STM)模块根据局部解剖内容动态调整每个网络块的时间嵌入,实现基于结构的自适应去噪。该方法直接在体素空间运行,无需有损压缩即可保持精细解剖细节,同时实现最高达10倍的训练加速。在涵盖CT、PET和MRI的四个数据集上的实验表明,该方法在去噪与超分辨率任务上均达到当前最优性能。代码已公开:https://github.com/mirthAI/sparse-3d-diffusion。
原文摘要 · Abstract (English)
Three-dimensional (3D) medical image enhancement, including denoising and super-resolution, is critical for clinical diagnosis in CT, PET, and MRI. Although diffusion models have shown remarkable success in 2D medical imaging, scaling them to high-resolution 3D volumes remains computationally prohibitive due to lengthy diffusion trajectories over high-dimensional volumetric data. We observe that in conditional enhancement, strong anatomical priors in the degraded input render dense noise schedules largely redundant. Leveraging this insight, we propose a sparse voxel-space diffusion framework that trains and samples on a compact set of uniformly subsampled timesteps. The network predicts clean data directly on the data manifold, supervised in velocity space for stable gradient scaling. A lightweight Structure-aware Trajectory Modulation (STM) module recalibrates time embeddings at each network block based on local anatomical content, enabling structure-adaptive denoising over the shared sparse schedule. Operating directly in voxel space, our framework preserves fine anatomical detail without lossy compression while achieving up to $10\times$ training acceleration. Experiments on four datasets spanning CT, PET, and MRI demonstrate state-of-the-art performance on both denoising and super-resolution tasks. Our code is publicly available at: https://github.com/mirthAI/sparse-3d-diffusion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。