arXiv:2601.18222cs.CV2026-01被引 1

用流匹配方法提升图像对齐精度,更好应对光照变化和多模态场景。

HomoFM: Deep Homography Estimation with Flow Matching

  • 将单应性估计建模为连续速度场学习,通过条件轨迹恢复高精度变换。
  • 在标准基准上优于当前最佳方法,尤其在光照变化和多模态匹配下表现更优。
  • 引入梯度反转层实现域不变特征学习,适合跨域图像配准任务。

深度单应性估计在计算机视觉与机器人领域有广泛应用。现有方法通常将其视为直接回归或迭代优化问题,难以捕捉复杂几何变换或跨域泛化。本文提出HomoFM,首次将生成模型中的流匹配技术引入单应性估计。不同于传统方法,我们将其建模为速度场学习问题:通过连续点对点的速度场,将噪声分布映射到配准坐标,网络沿条件流轨迹恢复高精度变换。为应对域偏移(如多模态匹配或光照变化),我们在特征提取主干中集成梯度反转层(GRL),显式约束编码器学习域不变表示,显著提升鲁棒性。大量实验表明,HomoFM在标准基准上优于现有最优方法,兼具更高精度与更强鲁棒性。代码与数据资源见https://github.com/hmf21/HomoFM。

原文摘要 · Abstract (English)

Deep homography estimation has broad applications in computer vision and robotics. Remarkable progresses have been achieved while the existing methods typically treat it as a direct regression or iterative refinement problem and often struggling to capture complex geometric transformations or generalize across different domains. In this work, we propose HomoFM, a new framework that introduces the flow matching technique from generative modeling into the homography estimation task for the first time. Unlike the existing methods, we formulate homography estimation problem as a velocity field learning problem. By modeling a continuous and point-wise velocity field that transforms noisy distributions into registered coordinates, the proposed network recovers high-precision transformations through a conditional flow trajectory. Furthermore, to address the challenge of domain shifts issue, e.g., the cases of multimodal matching or varying illumination scenarios, we integrate a gradient reversal layer (GRL) into the feature extraction backbone. This domain adaptation strategy explicitly constrains the encoder to learn domain-invariant representations, significantly enhancing the network's robustness. Extensive experiments demonstrate the effectiveness of the proposed method, showing that HomoFM outperforms state-of-the-art methods in both estimation accuracy and robustness on standard benchmarks. Code and data resource are available at https://github.com/hmf21/HomoFM.

单应性估计流匹配域适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。