通过解耦场景与外观,实现跨域图像配准的高精度鲁棒匹配。
Learning Domain-Invariant Representations for Cross-Domain Image Registration via Scene-Appearance Disentanglement
- 将图像分解为不变场景与特定外观特征,用重渲染替代直接强度匹配。
- 在ANHIR数据集上实现0.25%的中位相对配准误差,优于当前最佳方法7.4%。
- 适用于组织病理学等存在染色差异和形变的医学图像配准任务。
当源图像与目标图像存在系统性亮度差异时,传统配准方法依赖的亮度恒定假设被破坏,导致对应关系估计失效。本文提出SAR-Net框架,通过场景-外观解耦实现跨域图像配准。核心思想是将观测图像分解为域不变的场景表示与域特定的外观编码,从而基于重渲染而非直接强度匹配进行配准。我们建立了该分解实现一致跨域对齐的理论条件(命题1),并证明场景一致性损失可保证共享潜在空间中的几何对应关系(命题2)。在ANHIR(自动非刚性组织病理图像配准)挑战赛基准上验证,该方法在多染色病理图像(受染色协议差异与组织制备形变影响)上取得0.25%的中位相对目标配准误差(rTRE),优于当前最优的MEVIS方法(0.27%),提升7.4%,且具有99.1%的鲁棒性。代码已开源:https://github.com/D-ST-Sword/SAR-NET。
原文摘要 · Abstract (English)
Image registration under domain shift remains a fundamental challenge in computer vision and medical imaging: when source and target images exhibit systematic intensity differences, the brightness constancy assumption underlying conventional registration methods is violated, rendering correspondence estimation ill-posed. We propose SAR-Net, a unified framework that addresses this challenge through principled scene-appearance disentanglement. Our key insight is that observed images can be decomposed into domain-invariant scene representations and domain-specific appearance codes, enabling registration via re-rendering rather than direct intensity matching. We establish theoretical conditions under which this decomposition enables consistent cross-domain alignment (Proposition 1) and prove that our scene consistency loss provides a sufficient condition for geometric correspondence in the shared latent space (Proposition 2). Empirically, we validate SAR-Net on the ANHIR (Automatic Non-rigid Histological Image Registration) challenge benchmark, where multi-stain histopathology images exhibit coupled domain shift from different staining protocols and geometric distortion from tissue preparation. Our method achieves a median relative Target Registration Error (rTRE) of 0.25%, outperforming the state-of-the-art MEVIS method (0.27% rTRE) by 7.4%, with robustness of 99.1%. Code is available at https://github.com/D-ST-Sword/SAR-NET .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。