arXiv:2503.00908eess.IVcs.CV2025-03CVPR被引 29

用大模型生成解剖与扫描提示,实现低剂量CT去噪的个性化联邦学习。

Patient-Level Anatomy Meets Scanning-Level Physics: Personalized Federated Low-Dose CT Denoising Empowered by Large Language Model

  • 通过扫描与解剖双层提示,让模型根据个体特征自适应优化去噪
  • 在多个公开数据集上显著优于现有方法,对未知扫描协议也保持稳定性能
  • 适合医疗影像去噪、联邦学习及跨机构隐私保护场景

降低辐射剂量虽有益患者,但低剂量计算机断层扫描(LDCT)图像常因噪声和伪影影响临床诊断。尽管深度学习在LDCT重建中表现优异,但需大规模多客户端数据,引发隐私担忧。联邦学习(FL)可缓解此问题,但现有方法多针对特定扫描协议,泛化性差,难以应对未见协议。为此,我们提出SCAN-PhysFed,一种扫描与解剖双层级个性化的物理驱动联邦学习框架。由于LDCT噪声分布与扫描协议及被扫解剖结构密切相关,我们设计双层物理感知机制:将扫描协议信息和由医学大语言模型(MLLM)生成的放射科报告作为提示,嵌入物理感知超网络中,捕捉扫描与解剖特异性信息,实现双层级特征个性化。客户端专属解码器将这些个性化特征映射回图像域。此外,为应对未知数据,提出协议向量量化策略(PVQS),将未见扫描编码量化为已知代码簿中的编码,确保新客户端性能一致。大量实验表明,SCAN-PhysFed在多个公共数据集上均表现优越。

原文摘要 · Abstract (English)

Reducing radiation doses benefits patients, however, the resultant low-dose computed tomography (LDCT) images often suffer from clinically unacceptable noise and artifacts. While deep learning (DL) shows promise in LDCT reconstruction, it requires large-scale data collection from multiple clients, raising privacy concerns. Federated learning (FL) has been introduced to address these privacy concerns; however, current methods are typically tailored to specific scanning protocols, which limits their generalizability and makes them less effective for unseen protocols. To address these issues, we propose SCAN-PhysFed, a novel SCanning- and ANatomy-level personalized Physics-Driven Federated learning paradigm for LDCT reconstruction. Since the noise distribution in LDCT data is closely tied to scanning protocols and anatomical structures being scanned, we design a dual-level physics-informed way to address these challenges. Specifically, we incorporate physical and anatomical prompts into our physics-informed hypernetworks to capture scanning- and anatomy-specific information, enabling dual-level physics-driven personalization of imaging features. These prompts are derived from the scanning protocol and the radiology report generated by a medical large language model (MLLM), respectively. Subsequently, client-specific decoders project these dual-level personalized imaging features back into the image domain. Besides, to tackle the challenge of unseen data, we introduce a novel protocol vector-quantization strategy (PVQS), which ensures consistent performance across new clients by quantifying the unseen scanning code as one of the codes in the scanning codebook. Extensive experimental results demonstrate the superior performance of SCAN-PhysFed on public datasets.

低剂量CT联邦学习大模型去噪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。