让大模型像律师一样清晰推理,提升法律问答的可信度。
An Explicit Syllogistic Legal Reasoning Framework for Large Language Models
- 用树状检索整合法规和判例,构建明确的大前提。
- 两阶段微调使模型输出逻辑严谨、结构清晰的推理过程。
- 在中法文及不同用户群体中均表现优异,适合法律AI应用。
三段论推理对法律决策至关重要,能通过一般原则推导具体结论。尽管大语言模型(LLMs)可回答法律问题,但其输出常隐含、无结构,缺乏可解释性与可信度。为此,我们提出SyLeR框架,使LLMs能进行显式三段论法律推理。SyLeR采用树状分层检索机制,融合相关法律法规与判例,构建完整的大前提。随后通过两阶段微调:先监督微调建立基础推理能力,再以结构感知奖励机制引导强化学习,优化模型生成多样、逻辑严谨且结构清晰的推理路径。我们在多维度实验中评估了性能,涵盖领域内与跨领域用户(法律外行与专业人士)、中法双语及多种模型骨干(法律专用与通用大模型)。结果一致显示,SyLeR显著提升回答准确率,并稳定生成显式、可解释、可信的法律推理。
原文摘要 · Abstract (English)
Syllogistic reasoning is crucial for sound legal decision-making, allowing legal professionals to draw logical conclusions by applying general principles to specific case facts. While large language models (LLMs) can answer legal questions, they often struggle with explicit syllogistic reasoning. Their outputs tend to be implicit, unstructured, and consequently, less explainable and trustworthy. To overcome these limitations, we introduce SyLeR, a novel framework designed to enable LLMs to perform explicit syllogistic legal reasoning. SyLeR employs a tree-structured hierarchical retrieval mechanism to synthesize relevant legal statutes and precedents, thereby constructing comprehensive major premises. This is followed by a two-stage fine-tuning process: an initial supervised fine-tuning warm-up establishes a foundational understanding of syllogistic reasoning, while reinforcement learning, guided by a structure-aware reward mechanism, refines the model's capacity to generate diverse, logically sound, and well-structured reasoning paths. We conducted extensive experiments to evaluate SyLeR's performance. Our evaluations spanned diverse dimensions, including both in-domain and cross-domain user groups (legal laypersons and practitioners), multiple languages (Chinese and French), and various LLM backbones (legal-specific and open-domain LLMs). The results consistently demonstrate that SyLeR significantly enhances response accuracy and reliably produces explicit, explainable, and trustworthy legal reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。