用多模态检索增强生成事故责任判定,更准更可靠。
TrafficRAG: A Multimodal RAG Framework for Traffic Accident Liability Determination

- 用视觉语言模型提取事故关键信息,生成精准查询
- 融合稀疏与稠密检索,高效获取法规与判例
- 输出符合法律规范的标准化责任报告,适合司法辅助
交通事故责任分析是智能交通与法律援助中的关键挑战,现有方法普遍存在效率低、判断主观和结果不一致的问题。大型语言模型又受限于噪声视频输入和法律领域知识不足。为此,本文提出TrafficRAG,一种用于自动化交通事故分析与报告生成的多模态检索增强框架。该框架首先利用视觉语言模型生成事故场景的结构化文本描述,作为精确的检索查询;基于此查询,采用结合BM25稀疏检索与稠密向量检索的混合策略,获取相关交通法规与相似历史案例;最后,大模型融合检索到的法律知识与多模态事故证据进行综合推理,生成标准化、法律依据充分的责任分析报告。大量实验表明,TrafficRAG持续优于基线方法,在法律条文适配准确率(77.32%)、事实忠实度(81.71%)以及责任比例平均绝对误差(5.48%)上表现优异。结果验证了通过检索增强将多模态事实证据与法律条文结合,能有效提升交通事故责任判定的可靠性与准确性。
原文摘要 · Abstract (English)
Traffic accident liability analysis is a critical yet challenging task in intelligent transportation and legal assistance. Existing methods often suffer from low efficiency, subjective judgment, and inconsistent analysis results. Meanwhile, large language models are constrained by noisy video inputs and insufficient legal domain knowledge. To address these issues, this work presents TrafficRAG, a multimodal retrieval-augmented framework for automated traffic accident analysis and report generation. Specifically, the proposed framework first adopts a vision-language model to produce structured textual descriptions of accident scenarios, which serve as accurate retrieval queries. Based on these textual queries, a hybrid retrieval strategy integrating BM25 sparse retrieval and dense embedding retrieval is employed to fetch relevant traffic regulations and similar historical cases. Finally, the large language model incorporates retrieved legal knowledge and multimodal accident evidence for comprehensive reasoning, and generates standardized, legally grounded liability analysis reports. Extensive experiments show that TrafficRAG consistently outperforms baseline methods, achieving 77.32% Legal Norm Adaptation Accuracy, 81.71% Factual Faithfulness, and a Liability Ratio MAE of 5.48%. The results validate that integrating multimodal factual evidence with legal clauses via retrieval augmentation can effectively improve the reliability and accuracy of traffic accident liability determination.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。