用简单策略实现人眼级清晰边缘检测,无需复杂损失函数。
MEMO: Human-like Crisp Edge Detection Using Masked Edge Prediction
- 通过掩码输入训练学习信心梯度,生成清晰边缘
- 仅用交叉熵损失,边缘精度和清晰度均超越现有方法
- 适合追求高质量边缘图且不想调参的视觉任务研究者
基于学习的边缘检测模型若使用交叉熵损失,通常会产生过粗的边缘预测,与人类标注的单像素精细边缘不符。以往方法多依赖特殊损失函数或网络结构改进,而本文证明:仅通过精心设计的训练与推理策略即可实现人眼级边缘质量。我们提出掩码边缘预测模型MEMO,仅用交叉熵损失即可生成准确且清晰的边缘。首先构建大规模合成边缘数据集对MEMO进行预训练,提升泛化能力;后续在下游数据集上微调仅需增加1.2%参数量的轻量模块。训练中,模型在不同掩码比例下学习边缘预测;推理时利用一个关键洞察——粗边缘具有中心高、边界低的信心梯度,据此提出一种按置信度逐步细化的渐进式预测策略,使边缘更细更精确。该方法生成无需后处理的自然逼真边缘图,在清晰度评估中优于已有方法。
原文摘要 · Abstract (English)
Learning-based edge detection models trained with cross-entropy loss often suffer from thick edge predictions, which deviate from the crisp, single-pixel annotations typically provided by humans. While previous approaches to achieving crisp edges have focused on designing specialized loss functions or modifying network architectures, we show that a carefully designed training and inference strategy alone is sufficient to achieve human-like edge quality. In this work, we introduce the Masked Edge Prediction MOdel (MEMO), which produces both accurate and crisp edges using only cross-entropy loss. We first construct a large-scale synthetic edge dataset to pre-train MEMO, enhancing its generalization ability. Subsequent fine-tuning on downstream datasets requires only a lightweight module comprising 1.2\% additional parameters. During training, MEMO learns to predict edges under varying ratios of input masking. A key insight guiding our inference is that thick edge predictions typically exhibit a confidence gradient: high in the center and lower toward the boundaries. Leveraging this, we propose a novel progressive prediction strategy that sequentially finalizes edge predictions in order of prediction confidence, resulting in thinner and more precise contours. Our method achieves visually appealing, post-processing-free, human-like edge maps and outperforms prior methods on crispness-aware evaluations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。