arXiv:2511.01668cs.AI2025-11

融合检索与多模型的法律问答系统,减少幻觉并提升司法可信度。

Hybrid Retrieval-Augmented Generation Agent for Trustworthy Legal Question Answering in Judicial Forensics

  • 先检索可靠法律库,无匹配时用多模型生成并筛选最优答案。
  • 在Law_QA数据集上F1、ROUGE-L等指标显著优于单一模型和基础RAG。
  • 支持人工审核回写,实现知识动态更新,适合司法场景落地。

随着人工智能在司法鉴定中的渗透,确保法律问答的准确性与可追溯性至关重要。传统大语言模型易产生幻觉,可能误导法律咨询;而静态知识库难以跟上频繁更新的法律法规和判例。本文提出一种专为司法环境设计的混合式法律问答代理,融合检索增强生成(RAG)与多模型集成,实现可靠、可审计且持续更新的法律建议。系统优先检索:当可信法律库返回相关证据时,采用RAG生成答案;否则,由多个大模型生成候选答案,经专用选择器评分后返回最高分结果。高质量输出经人工审核后回写至知识库,实现知识动态演化与溯源追踪。在Law_QA数据集上的实验表明,该方法在F1、ROUGE-L及LLM-as-a-Judge指标上显著优于单模型基线和纯RAG流水线。消融实验验证了检索优先、模型集成与人机协同更新机制的互补作用。系统有效降低幻觉,提升答案质量与法律合规性,推动媒体鉴证技术在司法场景的实际应用。

原文摘要 · Abstract (English)

As artificial intelligence permeates judicial forensics, ensuring the veracity and traceability of legal question answering (QA) has become critical. Conventional large language models (LLMs) are prone to hallucination, risking misleading guidance in legal consultation, while static knowledge bases struggle to keep pace with frequently updated statutes and case law. We present a hybrid legal QA agent tailored for judicial settings that integrates retrieval-augmented generation (RAG) with multi-model ensembling to deliver reliable, auditable, and continuously updatable counsel. The system prioritizes retrieval over generation: when a trusted legal repository yields relevant evidence, answers are produced via RAG; otherwise, multiple LLMs generate candidates that are scored by a specialized selector, with the top-ranked answer returned. High-quality outputs then undergo human review before being written back to the repository, enabling dynamic knowledge evolution and provenance tracking. Experiments on the Law\_QA dataset show that our hybrid approach significantly outperforms both a single-model baseline and a vanilla RAG pipeline on F1, ROUGE-L, and an LLM-as-a-Judge metric. Ablations confirm the complementary contributions of retrieval prioritization, model ensembling, and the human-in-the-loop update mechanism. The proposed system demonstrably reduces hallucination while improving answer quality and legal compliance, advancing the practical landing of media forensics technologies in judicial scenarios.

法律AIRAG司法鉴证可信问答

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。