针对DSA影像插帧,提出并行多粒度建模方法,提升精度与去噪能力。
GaraMoSt: Parallel Multi-Granularity Motion and Structural Modeling for Efficient Multi-Frame Interpolation in DSA Images
- 设计并行网络架构,多粒度提取运动与结构特征。
- 在相同计算量下,显著降低高频与低频噪声,视觉效果更清晰。
- 适合需要实时高精度血管影像处理的医疗场景使用。
数字减影血管造影(DSA)图像的快速准确多帧插值对减少辐射、实现医生实时诊断与治疗至关重要。DSA图像包含复杂的血管结构和多种运动模式,直接应用自然场景视频插值方法会产生运动伪影、结构模糊和图像模糊。近期提出的MoSt-DSA首次针对性解决该问题并达到最先进水平,但其为追求实时性,对高频噪声抑制不足,低频噪声未完全滤除。为此,本文提出GaraMoSt,在相同计算时长内优化网络流程,引入名为MG-MSFE的模块,以全卷积并行方式在不同粒度下提取帧间相对运动与结构特征,并支持各尺度上下文感知粒度的独立灵活调节,从而提升计算效率与准确性。大量实验表明,GaraMoSt在精度、鲁棒性、视觉效果及噪声抑制方面全面超越MoSt-DSA及其他自然场景视频插值方法,达到当前最优水平。代码与模型已开源:https://github.com/ZyoungXu/GaraMoSt。
原文摘要 · Abstract (English)
The rapid and accurate direct multi-frame interpolation method for Digital Subtraction Angiography (DSA) images is crucial for reducing radiation and providing real-time assistance to physicians for precise diagnostics and treatment. DSA images contain complex vascular structures and various motions. Applying natural scene Video Frame Interpolation (VFI) methods results in motion artifacts, structural dissipation, and blurriness. Recently, MoSt-DSA has specifically addressed these issues for the first time and achieved SOTA results. However, MoSt-DSA's focus on real-time performance leads to insufficient suppression of high-frequency noise and incomplete filtering of low-frequency noise in the generated images. To address these issues within the same computational time scale, we propose GaraMoSt. Specifically, we optimize the network pipeline with a parallel design and propose a module named MG-MSFE. MG-MSFE extracts frame-relative motion and structural features at various granularities in a fully convolutional parallel manner and supports independent, flexible adjustment of context-aware granularity at different scales, thus enhancing computational efficiency and accuracy. Extensive experiments demonstrate that GaraMoSt achieves the SOTA performance in accuracy, robustness, visual effects, and noise suppression, comprehensively surpassing MoSt-DSA and other natural scene VFI methods. The code and models are available at https://github.com/ZyoungXu/GaraMoSt.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。