用NLP识别智利服务条款中的潜在滥用条款,填补西语法律文本分析空白。
Predicting potentially abusive clauses in Chilean terms of services with natural language processing
- 设计四类20种的标注体系,针对智利法规评估50份服务条款。
- 检测任务最高宏平均F1达89%,分类任务最高宏平均F1为70%。
- 首个西班牙语法律条款多标签数据集,助力拉美消费者权益保护。
本研究关注在线服务协议中信息不对称问题加剧的现状,因复杂且常被忽视的服务条款而恶化。现有自动分析方法多集中于英文和欧盟司法管辖区,存在显著局限。本文提出一种新方法与大规模数据集以弥补这一空白,设计包含四类共20个类别的标注体系,并应用于50份智利在线服务条款。对基于变换器的模型评估表明,语言与/或领域预训练、少样本数量及模型架构均影响潜在滥用条款的检测与分类效果。结果呈现任务与模型间性能差异显著:检测任务宏平均F1最高达79%–89%,微平均F1达96%;分类任务宏平均F1为60%–70%,微平均F1为64%–80%。这是首个基于智利法律的西班牙语多标签法律条款数据集,首次系统评估西班牙语模型在法律领域的表现。本工作为罕见法律分析方法发展奠定基础,有望推动智利及整个拉丁美洲的消费者支持应用。
原文摘要 · Abstract (English)
This study addresses the growing concern of information asymmetry in consumer contracts, exacerbated by the proliferation of online services with complex Terms of Service that are rarely even read. Even though research on automatic analysis methods is conducted, the problem is aggravated by the general focus on English-language Machine Learning approaches and on major jurisdictions, such as the European Union. We introduce a new methodology and a substantial dataset addressing this gap. We propose a novel annotation scheme with four categories and a total of 20 classes, and apply it on 50 online Terms of Service used in Chile. Our evaluation of transformer-based models highlights how factors like language- and/or domain-specific pre-training, few-shot sample size, and model architecture affect the detection and classification of potentially abusive clauses. Results show a large variability in performance for the different tasks and models, with the highest macro-F1 scores for the detection task ranging from 79% to 89% and micro-F1 scores up to 96%, while macro-F1 scores for the classification task range from 60% to 70% and micro-F1 scores from 64% to 80%. Notably, this is the first Spanish-language multi-label classification dataset for legal clauses, applying Chilean law and offering a comprehensive evaluation of Spanish-language models in the legal domain. Our work lays the ground for future research in method development for rarely considered legal analysis and potentially leads to practical applications to support consumers in Chile and Latin America as a whole.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。