分析复杂句结构对规则式原子句提取的影响,提升可解释性。
Rule-Based Approaches to Atomic Sentence Extraction
- 基于依存句法构建规则,分解复杂句为单一语义句。
- 在WikiSplit数据集上达到ROUGE-1 F1=0.6714,表现中等偏上。
- 揭示了从句、被动结构等难点,适合语法研究者参考。
自然语言常将多个概念融合于复杂句中。原子句提取旨在将复杂句拆分为表达单一思想的简单句,有助于信息检索、问答系统和自动推理。现有工作已形式化“拆分重述”任务并建立评估标准,基于大模型的机器学习方法提升了准确率,但缺乏可解释性,难以揭示失败原因。尽管已有研究探索依赖关系驱动的主谓宾三元组与从句提取,尚无系统分析特定从句结构与依存关系如何导致提取困难。本研究通过分析包含定语从句、状语从句、并列结构和被动语态在内的复杂句结构,评估其对规则式原子句提取的影响。使用WikiSplit数据集,在spaCy中实现依赖关系驱动的提取规则,生成100个黄金标准原子句集,采用ROUGE和BERTScore进行评估。结果表明,系统在ROUGE-1 F1达0.6714,ROUGE-2 F1为0.478,ROUGE-L F1为0.650,BERTScore F1为0.5898,显示词汇、结构与语义层面均有较好对齐。相对从句、同位语、并列谓语、状语从句及被动结构为主要挑战。总体而言,规则式提取具有合理准确性,但对句法复杂度敏感。
原文摘要 · Abstract (English)
Natural language often combines multiple ideas into complex sentences. Atomic sentence extraction, the task of decomposing complex sentences into simpler sentences that each express a single idea, improves performance in information retrieval, question answering, and automated reasoning systems. Previous work has formalized the "split-and-rephrase" task and established evaluation metrics, and machine learning approaches using large language models have improved extraction accuracy. However, these methods lack interpretability and provide limited insight into which linguistic structures cause extraction failures. Although some studies have explored dependency-based extraction of subject-verb-object triples and clauses, no principled analysis has examined which specific clause structures and dependencies lead to extraction difficulties. This study addresses this gap by analyzing how complex sentence structures, including relative clauses, adverbial clauses, coordination patterns, and passive constructions, affect the performance of rule-based atomic sentence extraction. Using the WikiSplit dataset, we implemented dependency-based extraction rules in spaCy, generated 100 gold=standard atomic sentence sets, and evaluated performance using ROUGE and BERTScore. The system achieved ROUGE-1 F1 = 0.6714, ROUGE-2 F1 = 0.478, ROUGE-L F1 = 0.650, and BERTScore F1 = 0.5898, indicating moderate-to-high lexical, structural, and semantic alignment. Challenging structures included relative clauses, appositions, coordinated predicates, adverbial clauses, and passive constructions. Overall, rule-based extraction is reasonably accurate but sensitive to syntactic complexity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。