通过因果构造提升多源图像融合的跨系统泛化能力
Additive Causal Construction for Transferable and Reconfigurable Cross-System Learning in Multi-Source Image Fusion

- 构建共享因果锚点实现跨系统图迁移,避免分布外性能下降
- 引入不确定性量化调节融合路径,抑制系统间混淆问题
- 适合医学影像等开放环境下需要稳定泛化的多源融合任务
在多源图像融合中,异构输入由不同生成机制驱动,可视为多个因果系统的组合。然而融合过程常出现跨系统差异(CSD)与跨系统纠缠(CSE),导致分布外(OOD)预测性能显著下降。为此,我们提出加性因果构造(ACC)框架,从两个层面建模:首先通过干预一致性建立跨系统共享的因果‘锚点’,实现因果图迁移性(CGT);其次将融合过程形式化为因果构造,并通过不确定性量化建模路径可靠性,保障因果图可重构性(CGR)。在此基础上,我们提出可学习的ACC-CRL方法,通过内容-机制解耦学习跨系统联合因果表示,在共享锚点下进行响应对齐以缓解CSD;并引入结构不确定性自适应调节融合过程,从而抑制不稳定的CSE。在合成数据(ColorMNIST)和真实世界多中心医学影像任务(微血管侵犯预测,MVI)上系统实验表明,该方法显著提升分布外泛化能力,同时保持分布内性能,验证了基于机制对齐与不确定性建模的ACC-CRL策略在开放环境中的有效性与鲁棒性。
原文摘要 · Abstract (English)
In multi-source image fusion scenarios, heterogeneous inputs are typically driven by distinct generative mechanisms and can be viewed as a composition of multiple causal systems. However, cross-system discrepancy (CSD) and cross-system entanglement (CSE) commonly arise during the fusion process, often leading to significant performance degradation under out-of-distribution (OOD) predictions. To address the CSD and CSE issues, we propose the additive causal construction (ACC) framework, which characterizes information fusion at two levels: firstly, it establishes causal "anchors" shared among multiple systems through intervention consistency to enable causal graph transferability (CGT); and secondly, it formalizes the fusion process as causal construction and models the reliability of constructed paths through uncertainty quantification to ensure causal graph reconfigurability (CGR). Building upon this, we revisit the traditional causal representation learning (CRL) with ACC and propose ACC-CRL as a learnable instantiation of the framework. The method explores joint causal content representations across systems via content-mechanism decoupling, and performs response alignment under shared anchors to mitigate CSD. Furthermore, it incorporates structural uncertainty to adaptively regulate the fusion process, thereby suppressing unstable CSE. We conduct systematic experiments on synthetic data (ColorMNIST) and real-world multi-center medical imaging tasks (microvascular invasion (MVI) prediction). The results demonstrate that the proposed method significantly improves OOD generalization while maintaining in-distribution (ID) performance, validating the effectiveness and robustness of the ACC-CRL strategy based on mechanism alignment and uncertainty modeling in open environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。