用单个耳机实时检测背后危险物体,低功耗高精度。
BlinkBud: Detecting Hazards from Behind via Sampled Monocular 3D Detection on a Single Earbud
- 用少量采样图像结合强化学习策略实现低功耗3D跟踪。
- 实测平均误报率4.90%,漏报率1.47%,功耗仅29.8mW。
- 适配头部晃动,适合行人与骑行者安全防护。
未能察觉身后快速接近的车辆对行人和骑行者构成巨大安全隐患。本文提出BlinkBud,利用单个耳塞与配对手机在线检测用户身后的危险物体。核心思路是通过耳塞采集少量图像样本,实现对视觉识别目标的精准追踪。为在保障最佳追踪精度的同时最小化耳塞与手机的功耗,设计了一种新型3D目标追踪算法,融合基于卡尔曼滤波的轨迹估计与基于强化学习的最优图像采样策略。此外,通过利用估算的俯仰角和偏航角,分别校正目标深度估计并对齐相机坐标系至用户身体坐标系,显著降低持续头部运动对追踪精度的影响。我们实现了BlinkBud原型系统,并进行了大量真实世界实验。结果表明,BlinkBud轻量级设计,耳塞与智能手机平均功耗分别为29.8 mW和702.6 mW,能以低平均误报率(FPR)4.90%和漏报率(FNR)1.47%准确检测危险物体。
原文摘要 · Abstract (English)
Failing to be aware of speeding vehicles approaching from behind poses a huge threat to the road safety of pedestrians and cyclists. In this paper, we propose BlinkBud, which utilizes a single earbud and a paired phone to online detect hazardous objects approaching from behind of a user. The core idea is to accurately track visually identified objects utilizing a small number of sampled camera images taken from the earbud. To minimize the power consumption of the earbud and the phone while guaranteeing the best tracking accuracy, a novel 3D object tracking algorithm is devised, integrating both a Kalman filter based trajectory estimation scheme and an optimal image sampling strategy based on reinforcement learning. Moreover, the impact of constant user head movements on the tracking accuracy is significantly eliminated by leveraging the estimated pitch and yaw angles to correct the object depth estimation and align the camera coordinate system to the user's body coordinate system, respectively. We implement a prototype BlinkBud system and conduct extensive real-world experiments. Results show that BlinkBud is lightweight with ultra-low mean power consumptions of 29.8 mW and 702.6 mW on the earbud and smartphone, respectively, and can accurately detect hazards with a low average false positive ratio (FPR) and false negative ratio (FNR) of 4.90% and 1.47%, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。