arXiv:2604.19464cs.CLcs.AI2026-04ACL被引 1

用结构化因素分类提升法律问题识别准确率,解决大模型误判难题

LePREC: Reasoning as Classification over Structured Factors for Assessing Relevance of Legal Issues

论文配图:LePREC: Reasoning as Classification over Structured Factors for Assessing Relevance of Legal Issues
图 1 · 摘自论文原文
  • 将法律描述转为问答对,提取多维度分析因素
  • 通过稀疏线性模型识别关键因素,准确率比GPT-4o高30%-40%
  • 适合法律科技、司法AI研究者,可解释性强

全球超半数人口因法律资源匮乏难以获得民事司法帮助。尽管大语言模型(LLMs)展现出强大推理能力,但在法律问题识别这一基础环节仍面临挑战。为此,我们基于769个真实马来西亚合同法案例构建数据集,利用GPT-4o提取事实并生成候选法律问题,经资深法律专家标注,发现大模型虽能生成多样问题,但准确率仅62%。针对此缺陷,提出LePREC(法律专业启发的推理提取与分类)框架,结合神经生成与结构化统计推理:1)神经模块用LLM将法律描述转化为代表多元分析因素的问答对;2)符号模块在离散特征上应用稀疏线性模型,学习显式代数权重以识别最具信息量的推理因素。相比端到端神经方法,LePREC在保持数据效率的同时实现可解释性。实验显示其性能较先进基线(包括GPT-4o和Claude)提升30%-40%,验证了基于相关性的因素-问题分析是更高效的相关性判断方案。

原文摘要 · Abstract (English)

More than half of the global population struggles to meet their civil justice needs due to limited legal resources. While Large Language Models (LLMs) have demonstrated impressive reasoning capabilities, significant challenges remain even at the foundational step of legal issue identification. To investigate LLMs' capabilities in this task, we constructed a dataset from 769 real-world Malaysian Contract Act court cases, using GPT-4o to extract facts and generate candidate legal issues, annotated by senior legal experts, which reveals a critical limitation: while LLMs generate diverse issue candidates, their precision remains inadequate (GPT-4o achieves only 62%). To address this gap, we propose LePREC (Legal Professional-inspired Reasoning Elicitation and Classification), a neuro-symbolic framework combining neural generation with structured statistical reasoning. LePREC consists of: (1) a neuro component leverages LLMs to transform legal descriptions into question-answer pairs representing diverse analytical factors, and (2) a symbolic component applies sparse linear models over these discrete features, learning explicit algebraic weights that identify the most informative reasoning factors. Unlike end-to-end neural approaches, LePREC achieves interpretability through transparent feature weighting while maintaining data efficiency through correlation-based statistical classification. Experiments show a 30-40% improvement over advanced LLM baselines, including GPT-4o and Claude, confirming that correlation-based factor-issue analysis offers a more data-efficient solution for relevance decisions.

法律AI可解释性分类模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。