arXiv:2410.05882eess.IVcs.CV2024-10中稿 · publication in Com…被引 2

用在线学习RNN和变压器预测动态胸腹MRI,缓解放疗延迟带来的定位误差。

Frame forecasting in cine MRI using the PCA respiratory motion model: comparing recurrent neural networks trained online and transformers

  • 基于PCA分解呼吸运动,用在线学习RNN与变压器预测时间权重。
  • 短期预测误差低至1.3mm,中长期预测优于传统方法,尤其在高变异数据上表现稳定。
  • 适合需要实时影像补偿的放疗场景,对数据量少和跨域情况有较好适应性。

呼吸运动导致胸腹部肿瘤放疗时靶区位置不确定,因治疗系统存在延迟。本文针对胸腹腔动态MRI帧预测问题,提出一种基于主成分分析(PCA)的呼吸运动建模方法,将Lucas-Kanade光流场分解为静态形变模式与低维时变权重。比较了多种方法预测这些权重:线性滤波器、群体与序列特异性变压器编码器,以及采用实时循环学习(RTRL)、无偏在线循环优化、解耦神经接口和稀疏单步近似(SnAp-1)训练的RNN。通过预测位移对参考帧进行形变,生成未来图像。预测精度随预测时长增加而下降。在ETH Zürich数据集上,线性回归在短时预测(h=0.32s)误差最低,仅1.3mm;RTRL与SnAp-1在中长时预测中表现更优,分别达到1.4mm与2.8mm几何误差。序列特异性变压器在低中等时序表现良好,但整体受限于数据稀缺与跨数据集分布差异。生成图像视觉上接近真实帧,但在吸气末期膈肌区域及非平面运动区域存在明显误差。

原文摘要 · Abstract (English)

Respiratory motion complicates accurate irradiation of thoraco-abdominal tumors during radiotherapy, as treatment-system latency entails target-location uncertainties. This work addresses frame forecasting in chest and liver cine MRI to compensate for such delays. We investigate RNNs trained with online learning algorithms, enabling adaptation to changing respiratory patterns via on-the-fly parameter updates, and transformers, increasingly common in time-series forecasting for their ability to capture long-term dependencies. Experiments used 12 sagittal thoracic and upper-abdominal cine-MRI sequences from ETH Zürich and OvGU; the OvGU data exhibited higher motion variability, noise, and lower contrast. PCA decomposes the Lucas-Kanade optical-flow field into static deformation modes and low-dimensional, time-dependent weights. We compare various methods for forecasting these weights: linear filters, population and sequence-specific transformer encoders, and RNNs trained with real-time recurrent learning (RTRL), unbiased online recurrent optimization, decoupled neural interfaces, and sparse one-step approximation (SnAp-1). Predicted displacements were used to warp the reference frame and generate future images. Prediction accuracy decreased with the horizon h. Linear regression performed best at short horizons (1.3mm geometrical error at h=0.32s, ETH Zürich dataset), while RTRL and SnAp-1 outperformed the other algorithms at medium-to-long horizons, with geometrical errors below 1.4mm and 2.8mm on the sequences from ETH Zürich and OvGU, respectively. The sequence-specific transformer was competitive for low-to-medium horizons, but transformers remained overall limited by data scarcity and domain shift between datasets. Predicted frames visually resembled the ground truth, with notable errors occurring near the diaphragm at end-inspiration and regions affected by out-of-plane motion.

医学影像时间序列RNNTransformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。