用注意力与大模型提示,让法律判决自动匹配法条并给出可理解的解释。
Explainable Statute Prediction via Attention-based Model and LLM Prompting
- 通过句子级注意力捕捉案情关键句,预测相关法条。
- 用大模型零样本提示生成法条预测与解释,支持链式思考。
- 双模型在两个数据集上表现优越,解释通过人工与反事实验证有效。
本文研究自动法条预测问题:给定案件描述,预测其中相关的法条(如法案中的条款、子条款或章节)。该任务对法律AI助手和法律问答系统有重要价值。为提升用户对法律AI的信任度,预测结果需附带人类可读的解释。提出两种方法:(i) AoS(句子注意力)使用小型语言模型(句子嵌入)进行有监督训练,通过句子注意力识别关键信息;(ii) LLMPrompt 利用大型语言模型进行零样本推理,采用标准提示与思维链(CoT)提示技术,同时完成预测与解释生成。两者均输出自然语言解释。在两个主流数据集上对比了两种方法与多个基线模型的法条预测性能,并通过自动化反事实测试与人工评估验证解释质量。
原文摘要 · Abstract (English)
In this paper, we explore the problem of automatic statute prediction where for a given case description, a subset of relevant statutes are to be predicted. Here, the term "statute" refers to a section, a sub-section, or an article of any specific Act. Addressing this problem would be useful in several applications such as AI-assistant for lawyers and legal question answering system. For better user acceptance of such Legal AI systems, we believe the predictions should also be accompanied by human understandable explanations. We propose two techniques for addressing this problem of statute prediction with explanations -- (i) AoS (Attention-over-Sentences) which uses attention over sentences in a case description to predict statutes relevant for it and (ii) LLMPrompt which prompts an LLM to predict as well as explain relevance of a certain statute. AoS uses smaller language models, specifically sentence transformers and is trained in a supervised manner whereas LLMPrompt uses larger language models in a zero-shot manner and explores both standard as well as Chain-of-Thought (CoT) prompting techniques. Both these models produce explanations for their predictions in human understandable forms. We compare statute prediction performance of both the proposed techniques with each other as well as with a set of competent baselines, across two popular datasets. Also, we evaluate the quality of the generated explanations through an automated counter-factual manner as well as through human evaluation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。