arXiv:2411.00527eess.IVcs.CV2024-11被引 2

构建近场多模态深度数据集,对比雷达与光学传感器性能

MAROON: A Dataset for the Joint Characterization of Near-Field High-Resolution Radio-Frequency and Optical Depth Imaging Techniques

  • 通过多模态标定联合测量四种深度传感器
  • 发现部分透射材料存在散射效应,雷达信号响应受材质影响
  • 适合研究近场成像、多传感器融合的开发者使用

利用波长特异性测距或深度传感器的互补优势,对自动驾驶等计算机辅助任务至关重要。然而,针对近距离(目标距离传感器仅几十厘米)的光学深度传感器与雷达的交叉研究仍较少。随着高分辨率近场成像雷达的发展,其性能与传统光学传感器的对比成为关键问题。本文提出一种多模态空间标定方法,联合表征四种深度传感器:三种不同原理的光学传感器和一部成像雷达。系统评估了它们在不同物体材质、几何形状及物距下的深度测量表现,揭示了部分透射材料的散射效应,并分析了射频信号的响应特性。所有测量数据将公开发布为多模态数据集MAROON。

原文摘要 · Abstract (English)

Utilizing the complementary strengths of wavelength-specific range or depth sensors is crucial for robust computer-assisted tasks such as autonomous driving. Despite this, there is still little research done at the intersection of optical depth sensors and radars operating close range, where the target is decimeters away from the sensors. Together with a growing interest in high-resolution imaging radars operating in the near field, the question arises how these sensors behave in comparison to their traditional optical counterparts. In this work, we take on the unique challenge of jointly characterizing depth imagers from both, the optical and radio-frequency domain using a multimodal spatial calibration. We collect data from four depth imagers, with three optical sensors of varying operation principle and an imaging radar. We provide a comprehensive evaluation of their depth measurements with respect to distinct object materials, geometries, and object-to-sensor distances. Specifically, we reveal scattering effects of partially transmissive materials and investigate the response of radio-frequency signals. All object measurements will be made public in form of a multimodal dataset, called MAROON.

多模态感知近场成像深度估计雷达融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。