用扩散模型提升弱监督低光语义分割的准确性
Diffusion-Guided Knowledge Distillation for Weakly-Supervised Low-Light Semantic Segmentation
- 通过扩散去噪与知识蒸馏对齐明暗图像特征
- 在低光条件下实现当前最优分割性能
- 适合低光场景下减少人工标注的研究者
弱监督语义分割旨在使用弱标注为每个像素分配类别标签,显著降低人工标注成本。尽管现有方法在光照充足场景中取得显著进展,但在低光环境下性能大幅下降,主要受两大因素制约:图像质量严重退化(如低对比度、噪声、色彩失真)以及弱监督本身的局限性。这些因素导致类激活图不可靠、伪标签语义模糊,最终影响模型学习判别性特征的能力。为此,本文提出扩散引导的知识蒸馏框架DGKD-WLSS,融合扩散引导知识蒸馏(DGKD)与深度引导特征融合(DGF2)。DGKD通过基于扩散的去噪与知识蒸馏对齐正常光照与低光照特征,DGF2则引入深度图作为光照不变的几何先验,增强结构特征学习。大量实验表明,DGKD-WLSS在低光条件下的弱监督语义分割任务中达到当前最优性能。代码已开源:https://github.com/ChunyanWang1/DGKD-WLSS。
原文摘要 · Abstract (English)
Weakly-supervised semantic segmentation aims to assign category labels to each pixel using weak annotations, significantly reducing manual annotation costs. Although existing methods have achieved remarkable progress in well-lit scenarios, their performance significantly degrades in low-light environments due to two fundamental limitations: severe image quality degradation (e.g., low contrast, noise, and color distortion) and the inherent constraints of weak supervision. These factors collectively lead to unreliable class activation maps and semantically ambiguous pseudo-labels, ultimately compromising the model's ability to learn discriminative feature representations. To address these problems, we propose Diffusion-Guided Knowledge Distillation for Weakly-Supervised Low-light Semantic Segmentation (DGKD-WLSS), a novel framework that synergistically combines Diffusion-Guided Knowledge Distillation (DGKD) with Depth-Guided Feature Fusion (DGF2). DGKD aligns normal-light and low-light features via diffusion-based denoising and knowledge distillation, while DGF2 integrates depth maps as illumination-invariant geometric priors to enhance structural feature learning. Extensive experiments demonstrate the effectiveness of DGKD-WLSS, which achieves state-of-the-art performance in weakly supervised semantic segmentation tasks under low-light conditions. The source codes have been released at:https://github.com/ChunyanWang1/DGKD-WLSS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。