AI在法律推理中难担重任,本文揭示其核心缺陷与改进路径。
Challenges for Generative AI in Legal Reasoning
- 拆解法律推理关键挑战:框架选择、判例区分、模糊条款处理等
- 现有AI增强技术仅能解决部分简单问题,无法应对需自由裁量的复杂案情
- 建议分阶段应用,优先提升效率,长期投入可解释性与合法性建模
大型语言模型(LLMs)正被引入专业领域,但在法律等高风险场景中的局限性仍不明确。本文列举生成式AI在司法决策中作为可靠推理工具所面临的重大挑战,包括跨辖区选择正确法律框架、基于法律渊源理论构建合理论证、区分判例中的判决理由与附带意见、处理“合理性”等一般条款引发的歧义、解决法律条文冲突,以及正确适用举证责任。论文将检索增强生成(RAG)、多智能体系统和神经符号AI等增强机制映射到上述挑战,评估其能否弥合LLM的概率性与法律解释所需的严格选择性之间的差距。此外,提出将法律要求分为规范性、教义性、证据性和技术性四类,并转化为可测试的领域特定设计义务。研究发现,这些技术仅能缓解局部问题,难以应对涉及裁量权和透明可辩护推理的核心难题。因此,建议采取渐进式采纳策略:先利用现有技术在简单案件中提升效率,持续投入研发可处理层级关系、时间性等法律特性的新方法,为未来扩展至复杂裁判奠定基础。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are being integrated into professional domains, yet their limitations in such high-stakes fields as law remain poorly understood. In response, this paper introduces examples of critical challenges to the functioning of generative and other forms of artificial intelligence (AI) as reliable reasoning tools in judicial decision-making. The study deconstructs core requirements and challenges for AI, including the ability to select the correct legal framework across jurisdictions, generate sound arguments based on the doctrine of the sources of law, distinguish ratio decidendi and obiter dicta in case law, resolve ambiguity arising from general clauses like "reasonableness", manage conflicting legal provisions, and apply the burden of proof correctly. The paper maps various AI enhancement mechanisms, such as retrieval-augmented generation (RAG), multi-agent systems and neuro-symbolic AI, to these challenges, assessing their potential to bridge the gap between the probabilistic nature of LLMs and the rigorous, choice-driven demands of legal interpretation. Furthermore, the paper sketches a path towards an evaluation framework, proposing that legal requirements be organized into normative, doctrinal, evidential, and technical categories, and subsequently operationalized into domain-specific, testable design obligations. The findings indicate that these techniques can address specific narrow challenges, but they fail to solve the more significant ones, particularly in tasks requiring discretion and transparent, justifiable reasoning. Therefore, we advocate for a staged adoption, first capturing efficiency in simple cases with technology already available today and sustaining long-term investment in new methods that handle hierarchy, temporality, and other requirements of legally sound reasoning, thus enabling expansion to complex adjudication in the future.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。