arXiv:2602.12639cs.CL2026-02中稿 · LREC 2026

用混合方法评估中文法律文本风格,比人工更准更透明。

CLASE: A Hybrid Method for Chinese Legalese Stylistic Evaluation

  • 结合语言特征与大模型经验评分,无需参考文本
  • 200份文书测试中,得分与人评高度一致
  • 提供可解释的改进建议,适合法律AI开发者

大型语言模型生成的法律文本通常具备合理的事实准确性,但往往不符合法律写作的专业风格和语言规范。为提升风格质量,首要任务是建立可靠的评估方法。然而,让法律专家手动制定评价标准不切实际,因法律写作中的隐性风格要求难以形式化。现有自动评估方法也存在不足:基于参考的指标混淆了语义准确性和风格一致性,而大模型作为评判者的方法则存在透明度低、结果不一致的问题。为此,我们提出CLASE(中文法律文风评估),一种聚焦法律文本风格表现的混合评估方法。该方法采用融合评分机制,结合1)语言特征得分和2)经验引导的大模型评分。特征系数与大模型评分经验均通过真实法律文档与其大模型还原版本的对比对学习获得。这种混合设计以透明、无参考的方式捕捉表层特征与隐含风格规范。在200份中文法律文书上的实验表明,CLASE相较于传统指标和纯大模型评判方法,在与人工判断的一致性上显著提升。除更高一致性外,CLASE还提供可解释的得分分解和改进建议,为法律文本生成提供了可扩展、实用的风格评估解决方案。(代码与数据见:https://github.com/rexera/CLASE)

原文摘要 · Abstract (English)

Legal text generated by large language models (LLMs) can usually achieve reasonable factual accuracy, but it frequently fails to adhere to the specialised stylistic norms and linguistic conventions of legal writing. In order to improve stylistic quality, a crucial first step is to establish a reliable evaluation method. However, having legal experts manually develop such a metric is impractical, as the implicit stylistic requirements in legal writing practice are difficult to formalise into explicit rubrics. Meanwhile, existing automatic evaluation methods also fall short: reference-based metrics conflate semantic accuracy with stylistic fidelity, and LLM-as-a-judge evaluations suffer from opacity and inconsistency. To address these challenges, we introduce CLASE (Chinese LegAlese Stylistic Evaluation), a hybrid evaluation method that focuses on the stylistic performance of legal text. The method incorporates a hybrid scoring mechanism that combines 1) linguistic feature-based scores and 2) experience-guided LLM-as-a-judge scores. Both the feature coefficients and the LLM scoring experiences are learned from contrastive pairs of authentic legal documents and their LLM-restored counterparts. This hybrid design captures both surface-level features and implicit stylistic norms in a transparent, reference-free manner. Experiments on 200 Chinese legal documents show that CLASE achieves substantially higher alignment with human judgments than traditional metrics and pure LLM-as-a-judge methods. Beyond improved alignment, CLASE provides interpretable score breakdowns and suggestions for improvements, offering a scalable and practical solution for professional stylistic evaluation in legal text generation (Code and data for CLASE is available at: https://github.com/rexera/CLASE).

法律AI风格评估混合方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。