一次性完成肝肿瘤分割、增强回归和分类,提升临床诊断效率。
Adversarial Multi-Task Learning for Liver Tumor Segmentation, Dynamic Enhancement Regression, and Classification
- 设计多任务交互对抗网络,融合频谱特征提升动态MRI建模。
- 在238例数据上实现分割、回归与分类的协同优化,性能显著提升。
- 适合医学影像分析、多任务学习研究者参考使用。
肝肿瘤分割、动态增强回归和分类对临床评估至关重要。然而,以往工作未在端到端框架中同时实现这些任务,主要受限于缺乏捕捉任务间关联以促进相互提升的有效架构,以及难以有效提取动态MRI信息。为此,我们提出多任务交互对抗网络(MTI-Net),集成多域信息熵融合(MdIEF)机制,利用熵感知的高频谱信息,有效融合频率与谱域特征,增强动态MRI数据的提取与利用。网络引入任务交互模块,建立分割与回归间的高阶一致性,促进任务间协同。同时设计任务驱动判别器(TDD),捕捉任务间的内在高阶关系;采用浅层Transformer进行位置编码,捕获动态MRI序列内部关系。在238例患者的实验中,MTI-Net在多项任务上均表现优异,展现出辅助肝肿瘤临床评估的强大潜力。代码已开源:https://github.com/xiaojiao929/MTI-Net。
原文摘要 · Abstract (English)
Liver tumor segmentation, dynamic enhancement regression, and classification are critical for clinical assessment and diagnosis. However, no prior work has attempted to achieve these tasks simultaneously in an end-to-end framework, primarily due to the lack of an effective framework that captures inter-task relevance for mutual improvement and the absence of a mechanism to extract dynamic MRI information effectively. To address these challenges, we propose the Multi-Task Interaction adversarial learning Network (MTI-Net), a novel integrated framework designed to tackle these tasks simultaneously. MTI-Net incorporates Multi-domain Information Entropy Fusion (MdIEF), which utilizes entropy-aware, high-frequency spectral information to effectively integrate features from both frequency and spectral domains, enhancing the extraction and utilization of dynamic MRI data. The network also introduces a task interaction module that establishes higher-order consistency between segmentation and regression, thus fostering inter-task synergy and improving overall performance. Additionally, we designed a novel task-driven discriminator (TDD) to capture internal high-order relationships between tasks. For dynamic MRI information extraction, we employ a shallow Transformer network to perform positional encoding, which captures the relationships within dynamic MRI sequences. In experiments on a dataset of 238 subjects, MTI-Net demonstrates high performance across multiple tasks, indicating its strong potential for assisting in the clinical assessment of liver tumors. The code is available at: https://github.com/xiaojiao929/MTI-Net.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。