提出高效融合多模态感知不确定性的新方法,提升自动驾驶可靠性。
Hyperdimensional Uncertainty Quantification for Multimodal Uncertainty Fusion in Autonomous Vehicles Perception
- 用超维计算捕捉特征级认知不确定性,无需贝叶斯推断。
- 在3D检测和语义分割上分别提升2.01%和1.29%,精度优于主流方法。
- 计算量减少2.36倍、参数量少38.3倍,适合实际部署。
不确定性量化(UQ)对确保真实世界自动驾驶系统中机器学习模型的可靠性至关重要。然而,现有方法通常只量化任务级输出不确定性,忽略了多模态特征融合层面的认知不确定性,导致性能受限。此外,主流的不确定性量化方法(如贝叶斯近似)因训练与推理时计算开销大,难以实用化。本文提出一种新型确定性不确定性方法(HyperDUM),通过超维计算高效量化特征级认知不确定性。该方法利用通道和补丁级投影与打包技术,分别捕获通道和空间维度的不确定性。随后自适应加权多模态传感器特征,抑制不确定性传播并优化特征融合。实验表明,HyperDUM在3D目标检测任务上平均超越当前最优(SOTA)算法2.01%/1.27%,在语义分割任务中相比基线提升最高达1.29%。值得注意的是,其浮点运算量仅需SOTA方法的2.36倍,参数量最多减少38.30倍,为实际自动驾驶系统提供了高效解决方案。
原文摘要 · Abstract (English)
Uncertainty Quantification (UQ) is crucial for ensuring the reliability of machine learning models deployed in real-world autonomous systems. However, existing approaches typically quantify task-level output prediction uncertainty without considering epistemic uncertainty at the multimodal feature fusion level, leading to sub-optimal outcomes. Additionally, popular uncertainty quantification methods, e.g., Bayesian approximations, remain challenging to deploy in practice due to high computational costs in training and inference. In this paper, we propose HyperDUM, a novel deterministic uncertainty method (DUM) that efficiently quantifies feature-level epistemic uncertainty by leveraging hyperdimensional computing. Our method captures the channel and spatial uncertainties through channel and patch -wise projection and bundling techniques respectively. Multimodal sensor features are then adaptively weighted to mitigate uncertainty propagation and improve feature fusion. Our evaluations show that HyperDUM on average outperforms the state-of-the-art (SOTA) algorithms by up to 2.01%/1.27% in 3D Object Detection and up to 1.29% improvement over baselines in semantic segmentation tasks under various types of uncertainties. Notably, HyperDUM requires 2.36x less Floating Point Operations and up to 38.30x less parameters than SOTA methods, providing an efficient solution for real-world autonomous systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。