无需数据训练,用随机扰动自激励消除光声成像伪影
Zero-Shot Artifact2Artifact: Self-incentive artifact removal for photoacoustic imaging without any data
- 通过随机扰动原始数据生成伪影模式,让轻量网络自学习去伪影
- 在活体大鼠肝脏成像中将信噪比从17.48提升至43.46,仅需8秒
- 适合无标注数据或设备受限场景的实时光声成像修复
光声成像(PAI)结合了光学对比度与超声穿透深度,对临床应用至关重要。然而,由于探测器阵列稀疏且角度受限,3D PAI的重建质量常受伪影影响。现有迭代或深度学习方法要么耗时,要么需大量训练数据,限制了实际应用。本文提出零样本自激励伪影去除方法ZS-A2A,基于超轻量网络,利用伪影对数据缺失不规则性的敏感性,通过向采集的光声数据引入随机扰动,自发生成子集数据,从而激发网络学习重建结果中的伪影模式,实现零样本伪影去除。该方法无需训练数据或伪影先验知识,可适用于任意稀疏或角度受限配置下的3D PAI。对于最大振幅投影(MAP)图像或3D PAI切片图像,ZS-A2A采用自激励策略完成伪影去除,并提升信噪比(CNR)。在仿真和在体动物实验中验证表明,相比现有零样本方法,ZS-A2A达到最先进性能;在活体大鼠肝脏成像中,CNR从17.48提升至43.46,仅需8秒。项目代码将开源:https://github.com/JaegerCQ/ZS-A2A。
原文摘要 · Abstract (English)
Photoacoustic imaging (PAI) uniquely combines optical contrast with the penetration depth of ultrasound, making it critical for clinical applications. However, the quality of 3D PAI is often degraded due to reconstruction artifacts caused by the sparse and angle-limited configuration of detector arrays. Existing iterative or deep learning-based methods are either time-consuming or require large training datasets, significantly limiting their practical application. Here, we propose Zero-Shot Artifact2Artifact (ZS-A2A), a zero-shot self-supervised artifact removal method based on a super-lightweight network, which leverages the fact that reconstruction artifacts are sensitive to irregularities caused by data loss. By introducing random perturbations to the acquired PA data, it spontaneously generates subset data, which in turn stimulates the network to learn the artifact patterns in the reconstruction results, thus enabling zero-shot artifact removal. This approach requires neither training data nor prior knowledge of the artifacts, and is capable of artifact removal for 3D PAI. For maximum amplitude projection (MAP) images or slice images in 3D PAI acquired with arbitrarily sparse or angle-limited detector arrays, ZS-A2A employs a self-incentive strategy to complete artifact removal and improves the Contrast-to-Noise Ratio (CNR). We validated ZS-A2A in both simulation study and $ in\ vivo $ animal experiments. Results demonstrate that ZS-A2A achieves state-of-the-art (SOTA) performance compared to existing zero-shot methods, and for the $ in\ vivo $ rat liver, ZS-A2A improves CNR from 17.48 to 43.46 in just 8 seconds. The project for ZS-A2A will be available in the following GitHub repository: https://github.com/JaegerCQ/ZS-A2A.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。