arXiv:2504.17280cs.CV2025-04被引 3

EdgePoint2用轻量网络实现高效高精度关键点提取,适合边缘设备部署。

EdgePoint2: Compact Descriptors for Superior Efficiency and Accuracy

  • 设计轻量网络架构,兼顾效率与精度,支持32/48/64维紧凑描述子。
  • 引入正交Procrustes损失与相似性损失,提升嵌入空间的表达能力。
  • 提供14个子模型,适用于多样计算与通信约束场景。

关键点提取在结构光重建(SfM)和同步定位与地图构建(SLAM)等视觉任务中至关重要。尽管深度学习显著提升了性能,但通常伴随高昂计算开销,限制了其在实时边缘应用中的部署。现有轻量模型常在效率与精度间权衡,且高维描述子不利于分布式通信。本文提出EdgePoint2,一系列专为嵌入式系统边缘计算优化的关键点检测与描述神经网络。通过结合正交Procrustes损失与相似性损失,训练出低维但具竞争力的描述子(32/48/64维)。实验表明,EdgePoint2在多种挑战性场景下持续达到最先进(SOTA)的精度与效率,兼具灵活性、鲁棒性与通用性,是适配多样化计算与通信约束视觉任务的理想选择。

原文摘要 · Abstract (English)

The field of keypoint extraction, which is essential for vision applications like Structure from Motion (SfM) and Simultaneous Localization and Mapping (SLAM), has evolved from relying on handcrafted methods to leveraging deep learning techniques. While deep learning approaches have significantly improved performance, they often incur substantial computational costs, limiting their deployment in real-time edge applications. Efforts to create lightweight neural networks have seen some success, yet they often result in trade-offs between efficiency and accuracy. Additionally, the high-dimensional descriptors generated by these networks poses challenges for distributed applications requiring efficient communication and coordination, highlighting the need for compact yet competitively accurate descriptors. In this paper, we present EdgePoint2, a series of lightweight keypoint detection and description neural networks specifically tailored for edge computing applications on embedded system. The network architecture is optimized for efficiency without sacrificing accuracy. To train compact descriptors, we introduce a combination of Orthogonal Procrustes loss and similarity loss, which can serve as a general approach for hypersphere embedding distillation tasks. Additionally, we offer 14 sub-models to satisfy diverse application requirements. Our experiments demonstrate that EdgePoint2 consistently achieves state-of-the-art (SOTA) accuracy and efficiency across various challenging scenarios while employing lower-dimensional descriptors (32/48/64). Beyond its accuracy, EdgePoint2 offers significant advantages in flexibility, robustness, and versatility. Consequently, EdgePoint2 emerges as a highly competitive option for visual tasks, especially in contexts demanding adaptability to diverse computational and communication constraints.

关键点提取边缘计算轻量模型紧凑描述子

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。