用多智能体和大模型重排提升中文法律条文检索准确率
LegalMALR:Multi-Agent Query Understanding and LLM-Based Reranking for Chinese Statute Retrieval
- 构建多智能体系统生成多种合法语义的查询改写
- 在自建数据集CSAID上超越现有基线32.6%的命中率
- 适合需要精准法律条文匹配的司法辅助场景
法律条文检索对司法辅助至关重要,但真实法律查询常隐含、多议题且表达口语化或不完整,传统检索增强生成方法难以恢复所需法定要素。密集检索器仅关注查询字面形式,轻量重排器缺乏法律推理能力。我们提出LegalMALR框架,结合多智能体查询理解系统(MAS)与零样本大语言模型重排模块(LLM Reranker)。MAS通过迭代密集检索生成多样化的法律化查询改写,扩大候选覆盖范围;为稳定LLM生成的随机性,采用广义强化策略优化(GRPO)统一优化MAS策略。累积候选集由LLM Reranker进行自然语言法律推理,生成最终排序。我们构建了包含118个复杂中文法律查询的CSAID数据集,并在CSAID与公开的STARD基准上评估。实验表明,LegalMALR在分布内与分布外设置下均显著优于强基线RAG模型,验证了多视角查询解析、强化学习策略优化与大模型重排相结合的有效性。
原文摘要 · Abstract (English)
Statute retrieval is essential for legal assistance and judicial decision support, yet real-world legal queries are often implicit, multi-issue, and expressed in colloquial or underspecified forms. These characteristics make it difficult for conventional retrieval-augmented generation pipelines to recover the statutory elements required for accurate retrieval. Dense retrievers focus primarily on the literal surface form of the query, whereas lightweight rerankers lack the legal-reasoning capacity needed to assess statutory applicability. We present LegalMALR, a retrieval framework that integrates a Multi-Agent Query Understanding System (MAS) with a zero-shot large-language-model-based reranking module (LLM Reranker). MAS generates diverse, legally grounded reformulations and conducts iterative dense retrieval to broaden candidate coverage. To stabilise the stochastic behaviour of LLM-generated rewrites, we optimise a unified MAS policy using Generalized Reinforcement Policy Optimization(GRPO). The accumulated candidate set is subsequently evaluated by the LLM Reranker, which performs natural-language legal reasoning to produce the final ranking. We further construct CSAID, a dataset of 118 difficult Chinese legal queries annotated with multiple statutory labels, and evaluate LegalMALR on both CSAID and the public STARD benchmark. Experiments show that LegalMALR substantially outperforms strong Retrieval-augmented generation(RAG) baselines in both in-distribution and out-of-distribution settings, demonstrating the effectiveness of combining multi-perspective query interpretation, reinforcement-based policy optimisation, and large-model reranking for statute retrieval.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。