首个多中心TIPS预后数据集+多模态框架,提升生存率与并发症预测精度
Post-TIPS Prediction via Multimodal Interaction: A Multi-Center Dataset and Framework for Survival, Complication, and Portal Pressure Assessment
- 融合影像与临床数据的多模态交互机制,增强特征互补性
- 在多中心数据上实现生存、门压梯度与肝性脑病的联合预测,准确率显著提升
- 支持小样本标注与跨域泛化,适合临床预后建模研究者使用
经颈内静脉肝内门体分流术(TIPS)是治疗门脉高压的成熟手段,但术后生存率差异大且常出现明显肝性脑病,亟需精准术前预后模型。现有研究多基于术前CT或临床指标构建机器学习模型,面临三大挑战:(1) ROI标注耗时费力;(2) 单模态方法可靠性差、泛化能力弱;(3) 单一终点预测不完整。此外,公开数据集缺失制约了该领域研究。为此,我们提出MultiTIPS——首个公开的多中心TIPS预后数据集,并构建新型多模态预后框架。框架包含三模块:(1) 双选项分割,结合半监督与基础模型管道,在有限标注下实现鲁棒ROI分割;(2) 多模态交互,引入多粒度放射组学注意力(MGRA)、渐进正交解耦(POD)和临床引导预后增强(CGPE),实现跨模态特征交互与互补表示融合;(3) 多任务预测,采用分阶段训练策略,同步优化生存、门压梯度(PPG)与OHE预测。在MultiTIPS上的大量实验表明,该方法优于当前最优模型,具备强跨域泛化与可解释性,具有临床应用潜力。数据与代码已开源。
原文摘要 · Abstract (English)
Transjugular intrahepatic portosystemic shunt (TIPS) is an established procedure for portal hypertension, but provides variable survival outcomes and frequent overt hepatic encephalopathy (OHE), indicating the necessity of accurate preoperative prognostic modeling. Current studies typically build machine learning models from preoperative CT images or clinical characteristics, but face three key challenges: (1) labor-intensive region-of-interest (ROI) annotation, (2) poor reliability and generalizability of unimodal methods, and (3) incomplete assessment from single-endpoint prediction. Moreover, the lack of publicly accessible datasets constrains research in this field. Therefore, we present MultiTIPS, the first public multi-center dataset for TIPS prognosis, and propose a novel multimodal prognostic framework based on it. The framework comprises three core modules: (1) dual-option segmentation, which integrates semi-supervised and foundation model-based pipelines to achieve robust ROI segmentation with limited annotations and facilitate subsequent feature extraction; (2) multimodal interaction, where three techniques, multi-grained radiomics attention (MGRA), progressive orthogonal disentanglement (POD), and clinically guided prognostic enhancement (CGPE), are introduced to enable cross-modal feature interaction and complementary representation integration, thus improving model accuracy and robustness; and (3) multi-task prediction, where a staged training strategy is used to perform stable optimization of survival, portal pressure gradient (PPG), and OHE prediction for comprehensive prognostic assessment. Extensive experiments on MultiTIPS demonstrate the superiority of the proposed method over state-of-the-art approaches, along with strong cross-domain generalization and interpretability, indicating its promise for clinical application. The dataset and code are available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。