arXiv:2607.02919physics.med-phcs.AI2026-07

用谐波感知的Transformer直接从原始信号实时定位导管,精度达亚毫米级。

Harmonic-Aware Transformer for Real-Time Catheter Localization in Interventional Procedures of Magnetic Particle Imaging

  • 通过频域预处理提取2~8阶谐波,提升信噪比并保留运动特征
  • 六层变换器架构在真实数据上实现0.103±0.092毫米的最小L2误差
  • 每帧仅需0.55毫秒,可支持每秒1800帧的实时定位,适合复杂运动场景

磁粒子成像(MPI)能实现无辐射的实时导管追踪,适用于介入手术。本文提出一种谐波感知的Transformer框架,直接从原始MPI电压信号预测导管尖端位置,无需图像重建,显著降低计算延迟。该框架采用频域预处理,分离2至8阶驱动场谐波,增强信噪比同时保留运动相关特征。采用六层编码器与八注意力头的Transformer结构,学习三维接收轴(x, y, z)间的时空依赖关系,实现高精度三维定位。模型在模拟信号上训练,并在标准、弯曲及心搏样运动条件下的真实体外数据集上评估。结果表明,该方法达到亚毫米级定位精度:弯曲数据集下最小L2误差为0.103 ± 0.092 mm,各轴均值绝对误差(MAE)分别为0.039 ± 0.046 mm、0.054 ± 0.049 mm、0.060 ± 0.044 mm;所有数据集上MAE范围为0.165~0.655 mm,表现稳定。优化后推理延迟仅为0.55毫秒/帧,吞吐量约1800帧/秒,验证了其实时性。相比依赖图像重建的传统方法,本框架在精度、延迟和复杂运动鲁棒性方面均有提升,展现了谐波感知变压器在介入式MPI实时导管定位中的高效与可扩展潜力。

原文摘要 · Abstract (English)

Magnetic particle imaging (MPI) enables real-time, radiation-free tracking of magnetic nanoparticle-coated instruments, making it highly suitable for interventional procedures. This study proposes a harmonic-aware transformer framework that directly predicts catheter tip positions from raw MPI voltage signals, eliminating the need for image reconstruction and reducing computational latency. The framework incorporates frequency-domain preprocessing to isolate the 2nd to 8th drive-field harmonics, enhancing the signal-to-noise ratio while preserving motion-relevant features. A transformer architecture with six encoder layers and eight attention heads is employed to learn spatio-temporal dependencies across the three receive axes (x, y, z) for accurate three-dimensional position estimation. The model is trained on simulated MPI signals and evaluated on real in vitro datasets under standard, bending, and heartbeat-like motion conditions. The proposed method achieves sub-millimeter localization accuracy, with a minimum L2 error of 0.103 +/- 0.092 mm and mean absolute errors (MAEs) of 0.039 +/- 0.046 mm, 0.054 +/- 0.049 mm, and 0.060 +/- 0.044 mm along the (x, y, z) axes, respectively, for the bending dataset. Across all datasets, the MAE ranges from 0.165 mm to 0.655 mm, demonstrating consistent performance. The optimized inference achieves a latency of 0.55 ms per frame and a throughput of approximately 1800 frames per second, confirming real-time capability. Compared with conventional MPI-guided approaches relying on image reconstruction, the proposed framework provides improved accuracy, reduced latency, and enhanced robustness under complex motion conditions. These results highlight the potential of harmonic-aware transformer models as efficient and scalable solutions for real-time catheter localization in interventional MPI.

MPI实时定位Transformer导管追踪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。