修复图像恢复与检测的不稳定性,提升恶劣环境下的目标检测效果。
Delving into Cascaded Instability: A Lipschitz Continuity View on Image Restoration and Object Detection Synergy
- 从光滑性角度分析恢复与检测任务的差异,揭示级联框架的不稳定根源。
- 提出LROD框架,使检测器在训练中同步学习图像恢复能力,优化更稳定。
- 适用于低光、雾霾等复杂场景的目标检测,尤其适合改进YOLO系列模型。
为提升恶劣条件(如雾霾、低光照)下的检测鲁棒性,通常将图像恢复作为预处理步骤以增强图像质量。然而,恢复与检测网络之间的功能不匹配会引入不稳定性,且该问题尚未被充分研究。本文从Lipschitz连续性视角出发,分析了恢复与检测网络在输入空间和参数空间中的函数差异:恢复网络执行平滑连续的变换,而目标检测器具有不连续的决策边界,对微小扰动极为敏感。这种不匹配导致传统级联框架中,即使不可察觉的恢复噪声也会在检测阶段被放大,破坏梯度流并阻碍优化。为此,我们提出Lipschitz正则化目标检测(LROD),一种将图像恢复直接融入检测器特征学习的简单有效框架,使两任务在训练中保持一致的Lipschitz连续性。我们实现为Lipschitz正则化YOLO(LR-YOLO),可无缝扩展至现有YOLO检测器。在雾霾与低光照基准测试上的大量实验表明,LR-YOLO显著提升了检测稳定性、优化平滑性及整体准确率。
原文摘要 · Abstract (English)
To improve detection robustness in adverse conditions (e.g., haze and low light), image restoration is commonly applied as a pre-processing step to enhance image quality for the detector. However, the functional mismatch between restoration and detection networks can introduce instability and hinder effective integration -- an issue that remains underexplored. We revisit this limitation through the lens of Lipschitz continuity, analyzing the functional differences between restoration and detection networks in both the input space and the parameter space. Our analysis shows that restoration networks perform smooth, continuous transformations, while object detectors operate with discontinuous decision boundaries, making them highly sensitive to minor perturbations. This mismatch introduces instability in traditional cascade frameworks, where even imperceptible noise from restoration is amplified during detection, disrupting gradient flow and hindering optimization. To address this, we propose Lipschitz-regularized object detection (LROD), a simple yet effective framework that integrates image restoration directly into the detector's feature learning, harmonizing the Lipschitz continuity of both tasks during training. We implement this framework as Lipschitz-regularized YOLO (LR-YOLO), extending seamlessly to existing YOLO detectors. Extensive experiments on haze and low-light benchmarks demonstrate that LR-YOLO consistently improves detection stability, optimization smoothness, and overall accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。