提出频域感知方法,提升医学影像重建的真实感与准确性
Bridging Synthetic-to-Real Gaps: Frequency-Aware Perturbation and Selection for Single-shot Multi-Parametric Mapping Reconstruction
- 设计频域感知扰动与选择机制,增强跨域特征学习
- 在5名健康人、94例脑卒中、46例脑膜瘤患者数据上验证有效
- 适用于多参数成像和扩散张量成像,临床适配性强
以数据为中心的人工智能显著推动了医学成像发展,现有方法利用合成数据缓解数据稀缺问题,但引入了合成到真实之间的域差距。无监督域适应(UDA)在缺乏真实标签的任务中展现潜力,但在重建任务中应用仍不充分。尽管多重重叠回波分离(MOLED)实现超快多参数重建,但其在多种临床场景中的应用受限于域差距未有效缓解、结构完整性难维持以及映射精度不足。为此,本文提出频域感知扰动与选择(FPS),包括基于瓦斯曼距离调制的频域感知扰动(WDFP)和分层频域感知选择网络(HFSNet),融合频域自适应选择(FAS)、紧凑型FAS(cFAS)及特征感知架构融合(FAI)。具体而言,扰动在不确定性下激活域不变特征学习,选择在扰动范围内优化最优解,构建稳健闭环学习路径。在合成数据及5名健康志愿者、94例缺血性脑卒中患者、46例脑膜瘤患者的多样化真实临床数据上开展大量实验,验证了FPS的优越性与临床适用性。此外,该方法成功拓展至扩散张量成像(DTI),凸显其通用性与更广泛医学应用潜力。代码已开源:https://github.com/flyannie/FPS。
原文摘要 · Abstract (English)
Data-centric artificial intelligence (AI) has remarkably advanced medical imaging, with emerging methods using synthetic data to address data scarcity while introducing synthetic-to-real gaps. Unsupervised domain adaptation (UDA) shows promise in ground truth-scarce tasks, but its application in reconstruction remains underexplored. Although multiple overlapping-echo detachment (MOLED) achieves ultra-fast multi-parametric reconstruction, extending its application to various clinical scenarios, the quality suffers from deficiency in mitigating the domain gap, difficulty in maintaining structural integrity, and inadequacy in ensuring mapping accuracy. To resolve these issues, we proposed frequency-aware perturbation and selection (FPS), comprising Wasserstein distance-modulated frequency-aware perturbation (WDFP) and hierarchical frequency-aware selection network (HFSNet), which integrates frequency-aware adaptive selection (FAS), compact FAS (cFAS) and feature-aware architecture integration (FAI). Specifically, perturbation activates domain-invariant feature learning within uncertainty, while selection refines optimal solutions within perturbation, establishing a robust and closed-loop learning pathway. Extensive experiments on synthetic data, along with diverse real clinical cases from 5 healthy volunteers, 94 ischemic stroke patients, and 46 meningioma patients, demonstrate the superiority and clinical applicability of FPS. Furthermore, FPS is applied to diffusion tensor imaging (DTI), underscoring its versatility and potential for broader medical applications. The code is available at https://github.com/flyannie/FPS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。