arXiv:2512.11374cs.CLcs.CY2025-12被引 1

用AI分析捷克法院判决,揭示司法形式主义真相

Mining Legal Arguments to Study Judicial Formalism

  • 构建法律论证识别模型,自动分类8类法律论据
  • 在30万份判决中实现83.8%的形式主义判断准确率
  • 方法可复用于其他司法管辖区,代码开源

法院需为判决提供理由,但大规模系统分析司法推理仍具挑战。本研究通过自动化方法检测并分类捷克最高法院判决中的司法推理,验证中欧地区(CEE)形式主义判决的主张。我们创建了MADON数据集,包含272份判决、9,183段专家标注的段落,涵盖8种论证类型及整体形式主义标签,用于监督训练与评估。基于300,511份捷克法院判决语料,我们通过持续预训练将Transformer大语言模型适配至捷克法律领域,并实验了非对称损失与类别加权等方法应对数据不平衡问题。最佳模型在论证段落检测上达到82.6%的平衡F1值,传统法律论证分类达77.5%,判决形式主义/非形式主义分类达83.8%。三阶段流水线结合ModernBERT、Llama 3.1与传统特征机器学习,在降低计算成本的同时提升可解释性。实证结果挑战了关于中欧形式主义的主流叙事。研究证明法律论证挖掘可用于司法哲学分类,并展示其在计算法学中其他任务的潜力。该方法具有跨司法管辖区适用性,完整流程、数据集、指南、模型与源码已公开于https://github.com/trusthlt/madon。

原文摘要 · Abstract (English)

Courts must justify their decisions, but systematically analyzing judicial reasoning at scale remains difficult. This study tests claims about formalistic judging in Central and Eastern Europe (CEE) by developing automated methods to detect and classify judicial reasoning in decisions of Czech Supreme Courts using state-of-the-art natural language processing methods. We create the MADON dataset of 272 decisions from two Czech Supreme Courts with expert annotations of 9,183 paragraphs with eight argument types and holistic formalism labels for supervised training and evaluation. Using a corpus of 300,511 Czech court decisions, we adapt transformer LLMs to Czech legal domain through continued pretraining and we experiment with methods to address dataset imbalance including asymmetric loss and class weighting. The best models can detect argumentative paragraphs (82.6% Bal-F1), classify traditional types of legal argument (77.5% Bal-F1), and classify decisions as formalistic/non-formalistic (83.8% Bal-F1). Our three-stage pipeline combining ModernBERT, Llama 3.1, and traditional feature-based machine learning achieves promising results for decision classification while reducing computational costs and increasing explainability. Empirically, we challenge prevailing narratives about CEE formalism. We demonstrate that legal argument mining enables promising judicial philosophy classification and highlight its potential for other important tasks in computational legal studies. Our methodology can be used across jurisdictions, and our entire pipeline, datasets, guidelines, models, and source codes are available at https://github.com/trusthlt/madon.

法律AI司法分析论证挖掘自然语言处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。