用低秩分解自动识别并筛选出最无幻觉的视觉描述。
A Low-Rank Method for Vision Language Model Hallucination Mitigation in Autonomous Driving
- 通过低秩分解句子嵌入矩阵,从多个候选描述中分离出幻觉成分。
- 在NuScenes数据集上准确率达87%,优于基线19%、辩论法6-10%。
- 无需模型内部或真实参考,适合实时自动驾驶系统部署。
视觉语言模型(VLMs)在自动驾驶场景理解中应用日益广泛,但常产生与视觉输入不符的幻觉。当缺乏真实参考且无法访问模型内部时,检测和缓解幻觉极为困难。本文提出一种自包含的低秩方法,仅凭生成的多个候选描述,即可自动评估并排序其幻觉程度。通过构建句子嵌入矩阵,并将其分解为低秩共识分量与稀疏残差分量,利用残差大小进行评分:残差最小者被认为最无幻觉。在NuScenes数据集上的实验表明,该方法在识别无幻觉描述方面达到87%的准确率,相比未过滤基线提升19%,较多智能体辩论法提升6%-10%。残差大小与人类对幻觉的判断高度相关,验证了评分机制的有效性。此外,该方法易于并行化,推理时间比辩论法减少51%-67%,具备实时部署潜力。
原文摘要 · Abstract (English)
Vision Language Models (VLMs) are increasingly used in autonomous driving to help understand traffic scenes, but they sometimes produce hallucinations, which are false details not grounded in the visual input. Detecting and mitigating hallucinations is challenging when ground-truth references are unavailable and model internals are inaccessible. This paper proposes a novel self-contained low-rank approach to automatically rank multiple candidate captions generated by multiple VLMs based on their hallucination levels, using only the captions themselves without requiring external references or model access. By constructing a sentence-embedding matrix and decomposing it into a low-rank consensus component and a sparse residual, we use the residual magnitude to rank captions: selecting the one with the smallest residual as the most hallucination-free. Experiments on the NuScenes dataset demonstrate that our approach achieves 87% selection accuracy in identifying hallucination-free captions, representing a 19% improvement over the unfiltered baseline and a 6-10% improvement over multi-agent debate method. The sorting produced by sparse error magnitudes shows strong correlation with human judgments of hallucinations, validating our scoring mechanism. Additionally, our method, which can be easily parallelized, reduces inference time by 51-67% compared to debate approaches, making it practical for real-time autonomous driving applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。