用深度学习统一传统关键点检测,实现高密度、强适应性的智能关键点提取。
DeepDetect: Learning All-in-One Dense Keypoints
- 融合7种关键点和2种边缘检测器生成标注掩码,捕捉多样视觉线索。
- 在Oxford等数据集上达到0.9582的重复率和338,118个正确匹配,优于现有方法。
- 适合需要高鲁棒性与密集特征的三维重建、SLAM等场景使用。
关键点检测是图像配准、运动恢复结构、三维重建、视觉里程计和SLAM等任务的基础。传统检测器(如SIFT、ORB、BRISK、FAST)及学习型方法(如SuperPoint、R2D2、QuadNet、LIFT)虽性能优异,但仍存在对光照变化敏感、关键点密度与重复性低、在复杂场景下适应性差、缺乏语义理解等问题,常忽略视觉重要区域。本文提出DeepDetect,一种基于深度学习的智能全功能密集关键点检测器,融合经典检测器优势。首先,通过融合7种关键点和2种边缘检测器输出生成真实标签掩码,提取角点、斑点、显著边缘与纹理等多样化视觉特征。随后,使用轻量高效模型ESPNet,以融合掩码为监督信号训练,使DeepDetect能语义感知图像,在不同且退化的视觉条件下生成高密度关键点。在Oxford、HPatches和Middlebury数据集上的评估表明,DeepDetect超越其他检测器,取得0.5143(平均关键点密度)、0.9582(平均重复率)、338,118(正确匹配数)和842,045(立体3D重建体素数)的最优表现。
原文摘要 · Abstract (English)
Keypoint detection is the foundation of many computer vision tasks, including image registration, structure-from-motion, 3D reconstruction, visual odometry, and SLAM. Traditional detectors (SIFT, ORB, BRISK, FAST, etc.) and learning-based methods (SuperPoint, R2D2, QuadNet, LIFT, etc.) have shown strong performance gains yet suffer from key limitations: sensitivity to photometric changes, low keypoint density and repeatability, limited adaptability to challenging scenes, and lack of semantic understanding, often failing to prioritize visually important regions. We present DeepDetect, an intelligent, all-in-one, dense detector that unifies the strengths of classical detectors using deep learning. Firstly, we create ground-truth masks by fusing outputs of 7 keypoint and 2 edge detectors, extracting diverse visual cues from corners and blobs to prominent edges and textures in the images. Afterwards, a lightweight and efficient model: ESPNet, is trained using fused masks as labels, enabling DeepDetect to focus semantically on images while producing highly dense keypoints, that are adaptable to diverse and visually degraded conditions. Evaluations on Oxford, HPatches, and Middlebury datasets demonstrate that DeepDetect surpasses other detectors achieving maximum values of 0.5143 (average keypoint density), 0.9582 (average repeatability), 338,118 (correct matches), and 842,045 (voxels in stereo 3D reconstruction).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。