arXiv:2604.09643cs.CV2026-04

无需外部传感器,仅用声学数据实现手持三维光声成像的高精度定位与重建。

PA-SFM: Tracker-free differentiable acoustic radiation for freehand 3D photoacoustic imaging

论文配图:PA-SFM: Tracker-free differentiable acoustic radiation for freehand 3D photoacoustic imaging
图 1 · 摘自论文原文
  • 基于可微声辐射模型,仅用光声数据同步优化设备位置和图像重建。
  • 定位精度达亚毫米级,血管结构重建分辨率接近真实基准。
  • 适合临床手持设备,开源代码可复现,降低成像系统成本。

三维手持光声断层成像通常依赖笨重且昂贵的外部定位传感器来校正运动伪影,严重限制了其临床灵活性与可及性。为解决这一挑战,我们提出PA-SFM框架,仅利用单模态光声数据,通过可微声辐射建模实现无追踪器的传感器位姿恢复与高保真3D重建。不同于基于视觉特征的传统结构自运动(SFM)方法,PA-SFM将声波方程融入可微编程流程,结合高性能GPU加速的声辐射核,通过梯度下降同步优化3D光声源分布与传感器阵列位姿。为确保自由手持场景下的稳健收敛,引入粗到精优化策略,融合几何一致性检查与刚体约束以剔除运动异常值。通过数值模拟与在体大鼠实验验证,结果表明PA-SFM实现亚毫米级定位精度,并恢复出与真实基准相当的高分辨率3D血管结构,为临床手持光声成像提供低成本、软件定义的解决方案。源码已公开于https://github.com/JaegerCQ/PA-SFM。

原文摘要 · Abstract (English)

Three-dimensional (3D) handheld photoacoustic tomography typically relies on bulky and expensive external positioning sensors to correct motion artifacts, which severely limits its clinical flexibility and accessibility. To address this challenge, we present PA-SFM, a tracker-free framework that leverages exclusively single-modality photoacoustic data for both sensor pose recovery and high-fidelity 3D reconstruction via differentiable acoustic radiation modeling. Unlike traditional structure-from-motion (SFM) methods based on visual features, PA-SFM integrates the acoustic wave equation into a differentiable programming pipeline. By leveraging a high-performance, GPU-accelerated acoustic radiation kernel, the framework simultaneously optimizes the 3D photoacoustic source distribution and the sensor array pose via gradient descent. To ensure robust convergence in freehand scenarios, we introduce a coarse-to-fine optimization strategy that incorporates geometric consistency checks and rigid-body constraints to eliminate motion outliers. We validated the proposed method through both numerical simulations and in-vivo rat experiments. The results demonstrate that PA-SFM achieves sub-millimeter positioning accuracy and restores high-resolution 3D vascular structures comparable to ground-truth benchmarks, offering a low-cost, software-defined solution for clinical freehand photoacoustic imaging. The source code is publicly available at \href{https://github.com/JaegerCQ/PA-SFM}{https://github.com/JaegerCQ/PA-SFM}.

光声成像可微建模无追踪器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。