arXiv:2412.07768cs.CV2024-12TPAMI被引 2

让自动驾驶在运行中实时纠错,提升安全性。

Test-time Correction: An Online 3D Detection System via Visual Prompting

  • 用视觉提示动态修正3D检测错误,无需重新训练。
  • 在有限标注和零样本条件下仍显著提升纠错能力。
  • 适合部署后持续优化的自动驾驶系统研究者。

本文提出Test-time Correction(TTC),一种在线3D检测系统,通过利用多种辅助反馈实时纠正测试阶段的错误,旨在提升已部署自动驾驶系统的安全性。与传统固定不变的离线3D检测器不同,TTC可在推理过程中即时进行在线修正,使自动驾驶车辆能够适应新场景并降低部署风险。为此,我们为现有3D检测器引入了Online Adapter(OA)模块——一个基于视觉提示的查询生成器,用于实时修正。核心是视觉提示:从2D检测不匹配、道路描述或用户点击等辅助反馈中提取的目标图像描述,这些提示在推理过程中收集并存入视觉提示缓冲区,以支持未来帧的持续修正。借助该机制,TTC能持续识别高风险目标,实现可靠、自适应且通用的驾驶自主性。大量实验表明,TTC在即时错误修正方面显著优于冻结的3D检测器,即使在标注有限、零样本设置及恶劣条件下也表现优异。本工作希望激发后续关于自动驾驶部署后在线修正系统的研究。

原文摘要 · Abstract (English)

This paper introduces Test-time Correction (TTC), an online 3D detection system designed to rectify test-time errors using various auxiliary feedback, aiming to enhance the safety of deployed autonomous driving systems. Unlike conventional offline 3D detectors that remain fixed during inference, TTC enables immediate online error correction without retraining, allowing autonomous vehicles to adapt to new scenarios and reduce deployment risks. To achieve this, we equip existing 3D detectors with an Online Adapter (OA) module -- a prompt-driven query generator for real-time correction. At the core of OA module are visual prompts: image-based descriptions of objects of interest derived from auxiliary feedback such as mismatches with 2D detections, road descriptions, or user clicks. These visual prompts, collected from risky objects during inference, are maintained in a visual prompt buffer to enable continuous correction in future frames. By leveraging this mechanism, TTC consistently detects risky objects, achieving reliable, adaptive, and versatile driving autonomy. Extensive experiments show that TTC significantly improves instant error rectification over frozen 3D detectors, even under limited labels, zero-shot settings, and adverse conditions. We hope this work inspires future research on post-deployment online rectification systems for autonomous driving.

3D检测在线修正自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。