arXiv:2511.16361cs.CV2025-11被引 2

无需对齐即可实现高质量深度超分,解决真实场景中图像错位问题。

Multi-Order Matching Network for Alignment-Free Depth Super-Resolution

  • 通过多阶匹配机制自动寻找错位RGB中的相关特征。
  • 在未对齐数据集上达到优于传统方法的重建质量。
  • 适合实际应用中传感器错位的深度图超分辨率任务。

现有引导式深度超分辨率方法依赖于深度图与RGB图像严格空间对齐,但在真实场景中,由于硬件分离(如独立的RGB-D传感器)或机械振动、温差导致的校准漂移,难以获取严格对齐的数据,使现有方法性能下降。本文提出多阶匹配网络(MOMNet),一种无需对齐的新型框架,可自适应地从错位的RGB图像中检索并选择最相关的信息。该方法首先引入多阶匹配机制,联合执行零阶、一阶和二阶匹配,全面识别在多阶特征空间中与深度一致的RGB信息。为有效融合检索到的RGB与深度信息,进一步设计多阶聚合模块,利用多阶先验作为提示,促进从RGB到深度的有选择性特征传递。大量实验表明,MOMNet在未对齐与已对齐数据集上均表现出更优性能与更强泛化能力。

原文摘要 · Abstract (English)

Recent guided depth super-resolution methods are premised on the assumption of strict spatial alignment between depth and RGB, achieving high-quality depth reconstruction. However, in real-world scenarios, the acquisition of strictly aligned RGB-D is hindered by inherent hardware limitations (e.g., physically separate RGB-D sensors) and unavoidable calibration drift induced by mechanical vibrations or temperature variations. Consequently, existing approaches often suffer inevitable performance degradation when applied to misaligned real-world scenes. In this paper, we propose the Multi-Order Matching Network (MOMNet), a novel alignment-free framework that adaptively retrieves and selects the most relevant information from misaligned RGB. Specifically, our method begins with a multi-order matching mechanism, which jointly performs zero-order, first-order, and second-order matching to comprehensively identify RGB information consistent with depth across multi-order feature spaces. To effectively integrate the retrieved RGB and depth, we further introduce a multi-order aggregation composed of multiple structure detectors. This strategy uses multi-order priors as prompts to facilitate the selective feature transfer from RGB to depth. Extensive experiments demonstrate that MOMNet achieves superior performance and generalization across both unaligned and aligned datasets.

深度超分无对齐多阶匹配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。