arXiv:2409.06707cs.CVcs.LG2024-09被引 4

用门控机制融合合成数据知识,提升驾驶场景下行人过街预测精度

Gating Syn-to-Real Knowledge for Pedestrian Crossing Prediction in Safe Driving

  • 针对不同领域知识设计适配的迁移方法
  • 在PIE和JAAD数据集上超越现有最优方法
  • 适合需要高精度行人行为预测的自动驾驶研发

驾驶场景中的行人过街预测(PCP)对智能车辆安全运行至关重要。由于真实场景中行人过街行为观测有限,近年研究开始利用可灵活变化的合成数据提升预测性能,采用领域自适应框架。然而,不同领域知识存在显著分布差异,需针对性设计自适应方式。本文提出面向PCP的门控合成到真实知识迁移方法(Gated-S2R-PCP),旨在:1)为不同类型过街领域知识设计合适的自适应策略;2)通过门控知识融合,为特定场景转移适宜知识。具体构建包含3181个序列(489,740帧)的合成基准S2R-PCP-3181,涵盖行人位置、RGB图像、语义图与深度图。利用该合成数据,将知识迁移至PIE和JAAD两个真实挑战性数据集,获得优于当前最优方法的PCP性能。

原文摘要 · Abstract (English)

Pedestrian Crossing Prediction (PCP) in driving scenes plays a critical role in ensuring the safe operation of intelligent vehicles. Due to the limited observations of pedestrian crossing behaviors in typical situations, recent studies have begun to leverage synthetic data with flexible variation to boost prediction performance, employing domain adaptation frameworks. However, different domain knowledge has distinct cross-domain distribution gaps, which necessitates suitable domain knowledge adaption ways for PCP tasks. In this work, we propose a Gated Syn-to-Real Knowledge transfer approach for PCP (Gated-S2R-PCP), which has two aims: 1) designing the suitable domain adaptation ways for different kinds of crossing-domain knowledge, and 2) transferring suitable knowledge for specific situations with gated knowledge fusion. Specifically, we design a framework that contains three domain adaption methods including style transfer, distribution approximation, and knowledge distillation for various information, such as visual, semantic, depth, location, etc. A Learnable Gated Unit (LGU) is employed to fuse suitable cross-domain knowledge to boost pedestrian crossing prediction. We construct a new synthetic benchmark S2R-PCP-3181 with 3181 sequences (489,740 frames) which contains the pedestrian locations, RGB frames, semantic images, and depth images. With the synthetic S2R-PCP-3181, we transfer the knowledge to two real challenging datasets of PIE and JAAD, and superior PCP performance is obtained to the state-of-the-art methods.

行人预测域自适应合成数据自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。