无需形变估计,用注意力机制实现跨域图像配准。
Deformation-Free Cross-Domain Image Registration via Position-Encoded Temporal Attention
- 将图像分解为结构与外观,通过自适应归一化融合。
- 在两个基准上达最新性能,速度比SAS-Net快1.87倍。
- 适合处理有形变和外观差异的医学/纹理图像配准。
针对跨域图像配准中几何错位与外观差异耦合的问题,本文将其形式化为分解问题:将每幅图像分解为与域无关的场景表示和全局外观统计,使配准仅需将移动图像的场景结构与固定图像的外观通过自适应实例归一化(AdaIN)重组即可完成,无需显式估计形变场。为利用序列采集中的时序一致性,引入位置编码的跨帧注意力机制,结合可学习与正弦位置嵌入,在滑动窗口内通过多头注意力融合相邻帧上下文,增强场景表示。本文构建了GPEReg-Net模型,在两个基准上进行评估:FIRE-Reg-256(视网膜眼底图,半刚性)和HPatches-Reg-256(合成纹理块,仿射变换)。GPEReg-Net在两项任务上均达到当前最优表现(FIRE: SSIM=0.928, PSNR=33.47 dB;HPatches: SSIM=0.450, PSNR=21.01 dB),优于所有基线方法,包括基于形变的方法,且运行速度比SAS-Net快1.87倍。
原文摘要 · Abstract (English)
We address the problem of cross-domain image registration, where paired images exhibit coupled geometric misalignment and domain-specific appearance shift. We formalize this as a factorization problem: decomposing each image into a domain-invariant scene representation and a global appearance statistic, such that registration reduces to recombining the scene structure of the moving image with the appearance of the fixed image via Adaptive Instance Normalization (AdaIN). This factorization eliminates the need for explicit deformation field estimation. To exploit temporal coherence in sequential acquisitions, we introduce a position-encoded cross-frame attention mechanism that fuses learnable and sinusoidal position embeddings with multi-head attention over a sliding window of neighboring frames, enriching the scene representation with inter-frame context. We instantiate this framework as GPEReg-Net and evaluate on two benchmarks: FIRE-Reg-256 (retinal fundus, semi-rigid) and HPatches-Reg-256 (synthetic textured patches, affine). GPEReg-Net achieves state-of-the-art performance on both benchmarks (FIRE: SSIM = 0.928, PSNR = 33.47 dB; HPatches: SSIM = 0.450, PSNR = 21.01 dB), surpassing all baselines, including deformation-based methods, while running 1.87x faster than SAS-Net. Code: https://github.com/JiahaoQin/GPEReg-Net.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。