用4D注意力模型融合多模态时空数据,精准预测结直肠癌肝转移术后复发风险。
4D-ACFNet: A 4D Attention Mechanism-Based Prognostic Framework for Colorectal Cancer Liver Metastasis Integrating Multimodal Spatiotemporal Features
- 设计4D时空注意力机制,分离建模术后肝脏动态变化过程。
- 在197例患者上实现100%时间邻近准确率,显著优于现有方法。
- 适合临床医生和研究者用于肿瘤术后动态监测与个性化预后评估。
结直肠癌肝转移(CRLM)术后预后预测因肿瘤异质性、肝脏微环境动态演变及多模态数据融合不足而面临挑战。为此,我们提出4D-ACFNet,首个将轻量级时空建模、跨模态动态校准与个性化时间预测统一集成的框架。其核心为新型4D时空注意力机制,结合时空可分卷积(参数量减少41%)与虚拟时间戳编码,捕捉术后肝脏再生、脂肪变性等年度演化规律。跨模态特征对齐通过Transformer层联合优化模态对齐损失与解耦损失,有效缓解临床-影像数据间的尺度差异与冗余干扰。此外,动态预后决策模块通过时间上采样与门控分类头生成个性化年复发风险热图,突破传统方法在时序动态建模与跨模态对齐上的局限。在197例CRLM患者上的实验表明,模型达到100%时间邻近准确率(TAA),性能显著超越现有方法。本研究建立了首个术后动态监测的时空建模范式,可拓展至多癌种转移预后分析,推动精准外科从‘空间切除’迈向‘时空治愈’。
原文摘要 · Abstract (English)
Postoperative prognostic prediction for colorectal cancer liver metastasis (CRLM) remains challenging due to tumor heterogeneity, dynamic evolution of the hepatic microenvironment, and insufficient multimodal data fusion. To address these issues, we propose 4D-ACFNet, the first framework that synergistically integrates lightweight spatiotemporal modeling, cross-modal dynamic calibration, and personalized temporal prediction within a unified architecture. Specifically, it incorporates a novel 4D spatiotemporal attention mechanism, which employs spatiotemporal separable convolution (reducing parameter count by 41%) and virtual timestamp encoding to model the interannual evolution patterns of postoperative dynamic processes, such as liver regeneration and steatosis. For cross-modal feature alignment, Transformer layers are integrated to jointly optimize modality alignment loss and disentanglement loss, effectively suppressing scale mismatch and redundant interference in clinical-imaging data. Additionally, we design a dynamic prognostic decision module that generates personalized interannual recurrence risk heatmaps through temporal upsampling and a gated classification head, overcoming the limitations of traditional methods in temporal dynamic modeling and cross-modal alignment. Experiments on 197 CRLM patients demonstrate that the model achieves 100% temporal adjacency accuracy (TAA), with performance significantly surpassing existing approaches. This study establishes the first spatiotemporal modeling paradigm for postoperative dynamic monitoring of CRLM. The proposed framework can be extended to prognostic analysis of multi-cancer metastases, advancing precision surgery from "spatial resection" to "spatiotemporal cure."
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。