用手机激光雷达实现隐藏物体成像,无需额外设备
Imaging Hidden Objects with Consumer LiDAR via Motion Induced Sampling

- 通过运动诱导采样建模,融合多帧数据提升信号质量
- 在手机级激光雷达上实现3D重建、目标追踪和定位
- 适合移动端、机器人等消费级应用,成本低于100美元
激光雷达在手持、可穿戴和机器人应用中日益普及。这些传感器可达到皮秒级时间分辨率,理论上能获取视线外物体的信息。尽管科研级激光雷达已展示非视距(NLOS)成像能力,但消费设备因激光功率低、空间分辨率差及物体与相机运动,难以实现。受快拍摄影和合成孔径雷达启发,我们提出一种多帧融合策略,克服上述挑战,并首次在消费级激光雷达上实现NLOS成像。我们引入运动诱导孔径采样模型,统一描述物体形状、物体运动和相机运动的影响。基于该模型,我们在手机级激光雷达上展示了三种能力:(1) 3D重建,(2) 单目标与多目标追踪,(3) 利用隐藏物体进行相机定位。此前NLOS成像仅限于笨重昂贵的科研设备,需复杂设置与校准。本工作标志着向即插即用式非视距成像转变,用户仅需市售硬件(<100美元)即可实现隐藏物体成像,无需额外配置。我们认为,此类能力的普及将推动消费级NLOS成像应用发展。
原文摘要 · Abstract (English)
LiDARs are being increasingly deployed for consumer imaging in handheld, wearable, and robotic applications. These sensors can capture the time-of-flight of light at picosecond resolution, which in principle, enables them to capture information about objects hidden from their field of view. While such non-line-of-sight (NLOS) imaging capabilities have been shown on research-grade LiDARs, they are challenging to achieve on consumer devices due to poor signal quality resulting from low laser power, low spatial resolution, and object and camera motion. Inspired by burst photography and synthetic aperture radar, we propose a multi-frame fusion strategy to overcome these challenges and demonstrate NLOS imaging on consumer LiDAR. We first introduce the motion-induced aperture sampling model to unify the effects of object shape, object motion, and camera motion under a single measurement model. Using this model, we demonstrate several NLOS capabilities on a smartphone-grade LiDAR: (1) 3D reconstruction, (2) single and multi-object tracking, and (3) camera localization using hidden objects. Previously, NLOS imaging capabilities were largely restricted to bulky and expensive research-grade hardware that requires extensive setup and calibration. Our results represent a shift towards plug-and-play NLOS imaging, where anyone can image hidden objects with off-the-shelf hardware ($<100) and no additional setup. We believe that democratization of such capabilities will advance consumer applications of NLOS imaging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。