用伪深度图提升图像分割精度,速度远超传统方法。
High-Precision Dichotomous Image Segmentation via Depth Integrity-Prior and Fine-Grained Patch Strategy
- 引入伪深度图作为结构先验,融合RGB与深度特征增强感知。
- 在DIS-VD和DIS-TE数据集上达到Fmax 0.915,参数量不足扩散模型一半。
- 适合需要高精度且计算资源有限的细粒度图像分割任务。
高精度二值图像分割(DIS)旨在从高分辨率图像中提取细粒度目标。现有方法在效率与精度间权衡:非扩散方法虽快但语义弱、空间先验不稳,易误检;扩散方法精度高但计算开销大。深度图中,完整物体呈现低方差区域,内部平滑、边界锐利,背景则因不同深度的断续表面表现出混乱、高方差模式,我们称其为深度完整性先验。受此启发,鉴于当前DIS缺乏深度信息,我们利用单目深度估计模型生成伪深度图,以快速获取目标与背景间的空间差异性语义理解。为此提出先验引导的深度融合网络(PDFNet),融合RGB与伪深度特征实现深度感知结构解析。进一步设计深度完整性先验损失以强化分割中深度一致性,并引入自适应块选择的细粒度增强模块以锐化边界。值得注意的是,结合DAM-v2的PDFNet在DIS-VD和DIS-TE上分别取得Fmax 0.915,参数量不足扩散方法的一半。代码已开源。
原文摘要 · Abstract (English)
High-precision dichotomous image segmentation (DIS) is a task of extracting fine-grained objects from high-resolution images. Existing methods trade efficiency for accuracy: non-diffusion methods are fast but suffer from weak semantics and unstable spatial priors, causing false detections; diffusion-based methods offer high accuracy via strong generative priors but are computationally expensive. In depth maps, a complete object appears as a low variance region with a smooth interior and sharp boundaries, whereas the background exhibits a chaotic, high variance pattern due to disconnected surfaces at varying depths. We refer to this as the depth integrity-prior. Inspired by this, and noting that DIS currently lacks depth maps, we leverage pseudo-depth information from monocular depth estimation models to obtain essential semantic understanding, thereby rapidly revealing spatial differences across target objects and the background. To exploit this prior, we propose the Prior-guided Depth Fusion Network (PDFNet), which fuses RGB and pseudo-depth features for depth-aware structure perception. We further introduce a novel depth integrity-prior loss to enforce depth consistency in segmentation and a fine-grained enhancement module with adaptive patch selection to sharpen boundaries. Notably, PDFNet with DAM-v2 achieves SOTA (Fmax 0.915 on DIS-VD and 0.915 on DIS-TE) using less than half the params of diffusion-based methods. Our code is available at https://tennine2077.github.io/PDFNet.github.io/ .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。