arXiv:2412.06352cs.CV2024-12被引 5

通过语义引导增强特征,提升恶劣环境下的图像配准精度

SeFENet: Robust Deep Homography Estimation via Semantic-Driven Feature Enhancement

  • 用分层多尺度模块扩大感受野,提取复杂环境特征
  • 引入语义约束与感知框架,降低退化影响,误差降低41%以上
  • 适合图像配准、自动驾驶等对鲁棒性要求高的场景

在恶劣环境下拍摄的图像常出现模糊、对比度低和色彩失真,影响特征检测与匹配,进而降低单应性估计的准确性和鲁棒性。虽然视觉增强可改善清晰度,但可能引入视觉容许的伪影,破坏图像结构。鉴于语义信息对抗环境干扰的强韧性,本文提出语义驱动的特征增强网络SeFENet,用于鲁棒的单应性估计。首先设计一种新型分层尺度感知模块,通过聚合多尺度信息扩展感受野,有效提取多样恶劣条件下的图像特征。随后提出语义引导约束模块与高层感知框架,实现对退化具有容忍性的语义特征表达。采用元学习训练策略缓解语义与结构特征间的差异。通过内-外交替优化,网络实现隐式的语义级特征增强,强化局部特征理解与上下文信息提取能力。在正常与恶劣条件下实验表明,SeFENet显著优于现有最先进方法,在大规模数据集上点匹配误差降低至少41%。

原文摘要 · Abstract (English)

Images captured in harsh environments often exhibit blurred details, reduced contrast, and color distortion, which hinder feature detection and matching, thereby affecting the accuracy and robustness of homography estimation. While visual enhancement can improve contrast and clarity, it may introduce visual-tolerant artifacts that obscure the structural integrity of images. Considering the resilience of semantic information against environmental interference, we propose a semantic-driven feature enhancement network for robust homography estimation, dubbed SeFENet. Concretely, we first introduce an innovative hierarchical scale-aware module to expand the receptive field by aggregating multi-scale information, thereby effectively extracting image features under diverse harsh conditions. Subsequently, we propose a semantic-guided constraint module combined with a high-level perceptual framework to achieve degradation-tolerant with semantic feature. A meta-learning-based training strategy is introduced to mitigate the disparity between semantic and structural features. By internal-external alternating optimization, the proposed network achieves implicit semantic-wise feature enhancement, thereby improving the robustness of homography estimation in adverse environments by strengthening the local feature comprehension and context information extraction. Experimental results under both normal and harsh conditions demonstrate that SeFENet significantly outperforms SOTA methods, reducing point match error by at least 41% on the large-scale datasets.

单应性估计语义增强鲁棒配准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。