通过模拟法律条文修订,提升中文立法冲突分类准确率。
TypedCSIP: Typed Counterfactual Pretraining for Chinese Legislative Conflict Classification
- 用专家修改后的条文作为反事实监督信号训练模型
- 在测试集上比最强基线提升1.29个百分点的宏F1
- 适合法律AI研究者和政策自动化审查场景
TypedCSIP是一种针对LCR-CN基准的类型化反事实预训练方法:给定(上级、下级)条文对,判断是否存在冲突及其所属四类法律理论类型(责任、条件、处罚、定义)。利用LCR-CN中专家编写的最小修订作为训练时的反事实监督;测试时仅输入原始条文对。第一阶段在(上级、下级、专家修订)三元组上,以类型化反事实选择性干预目标预训练共享编码器,将专家修订视为无冲突证据的反事实;第二阶段将编码器迁移到五分类头。确认性测试在开放科学框架预注册,采用18个种子,要求每个种子的均值差异至少0.8个百分点,且种子自举与学生t检验95%置信下界均高于零。在696条记录的测试集上,v2版本在chinese-roberta-wwm-ext上相比最强单模型基线提升+0.916个百分点,在SAILER跨骨干复现中提升+1.288个百分点,两组均满足规则。对244条未见类别样本的冷启动分层结果仍保持正向增益。跨任务诊断显示第二阶段编码器为分类专用,不适用于LCR-CN的上级法检索任务,因此贡献限定于冲突分类。代码、72份预注册预测文件、匹配种子与MLM控制辅助数据及OSF预注册记录均已公开。
原文摘要 · Abstract (English)
TypedCSIP is a typed counterfactual pretraining method for the conflict-classification task of the LCR-CN benchmark (Zhao et al., 2026): given a (superior, subordinate) provision pair, predict whether the pair conflicts and which of four legal-doctrine types (Responsibility, Condition, Sanction, Definition) describes the inconsistency. We exploit LCR-CN's expert-written minimal revisions as training-time counterfactual supervision; at test time the classifier reads only the original pair. Stage 1 pretrains a shared encoder with a typed Counterfactual Selective Intervention Pretraining objective on (superior, subordinate, expert-revised) triplets, treating the expert revision as a counterfactual that the typed factor head must classify as carrying no conflict evidence. Stage 2 transfers the encoder to a five-way classification head. The confirmatory test was registered on the Open Science Framework before observing v6 measurements: 18 seeds, locked rule requiring mean per-seed difference at least 0.8 pp with both seed-bootstrap and Student-t 95% lower bounds above zero. On the 696-record test split, the v2 variant improves macro-F1 over the strongest single-model baseline by +0.916 pp on chinese-roberta-wwm-ext and +1.288 pp on the SAILER cross-backbone replication; both cells pass the rule. A cold-start stratified result on the 244 Unseen-gB records keeps the gain positive on both backbones. A cross-task diagnostic shows the Stage-2 encoder is classification-specialized and does not transfer to LCR-CN's superior-law retrieval task, so we scope the contribution to conflict classification. We release code, 72 pre-registered prediction files, matched-seed and MLM-control auxiliaries, and the OSF pre-registration record.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。