arXiv:2410.07695cs.CV2024-10被引 23

通过测试时一致性调整,提升阴影检测在真实图像中的泛化能力。

Test-Time Intensity Consistency Adaptation for Shadow Detection

  • 利用测试时图像增强版本间的亮度一致性约束优化预测
  • 在ISTD和SBU数据集上平衡错误率(BER)显著优于现有方法
  • 特别适用于光照复杂的真实场景阴影检测

阴影检测对计算机视觉中的准确场景理解至关重要,但受光照、物体几何和场景上下文差异影响,阴影外观多样。深度学习模型因训练数据规模小且多样性不足,难以泛化到真实图像。为此,本文提出TICA框架,在测试时利用光照强度信息进行自适应,通过强制同一图像的两个增强版本在阴影区域预测一致来提升精度。首先在标注数据集上训练基础编码器-解码器模型;测试时,针对每个样本,通过保持前后景交界区域的亮度预测一致性,实现鲁棒自适应。在ISTD和SBU数据集上的大量实验表明,TICA显著优于现有最先进方法,尤其在平衡错误率(BER)指标上表现优异。

原文摘要 · Abstract (English)

Shadow detection is crucial for accurate scene understanding in computer vision, yet it is challenged by the diverse appearances of shadows caused by variations in illumination, object geometry, and scene context. Deep learning models often struggle to generalize to real-world images due to the limited size and diversity of training datasets. To address this, we introduce TICA, a novel framework that leverages light-intensity information during test-time adaptation to enhance shadow detection accuracy. TICA exploits the inherent inconsistencies in light intensity across shadow regions to guide the model toward a more consistent prediction. A basic encoder-decoder model is initially trained on a labeled dataset for shadow detection. Then, during the testing phase, the network is adjusted for each test sample by enforcing consistent intensity predictions between two augmented input image versions. This consistency training specifically targets both foreground and background intersection regions to identify shadow regions within images accurately for robust adaptation. Extensive evaluations on the ISTD and SBU shadow detection datasets reveal that TICA significantly demonstrates that TICA outperforms existing state-of-the-art methods, achieving superior results in balanced error rate (BER).

阴影检测测试时适应图像增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。