arXiv:2504.05226cs.CL2025-04

构建首个基于树邻接语法的语料库,助力自然语言分析与理论研究。

Proposing TAGbank as a Corpus of Tree-Adjoining Grammar Derivations

  • 将句法树库自动映射为树邻接语法推导,实现结构转换。
  • 支持长距离依赖建模,提升解析与语义分析能力。
  • 适合语法研究者与形式化语言处理开发者使用。

lexicalized grammar(如树邻接语法,TAG)的发展推动了自然语言处理中句法与语义的理解。尽管已有如Penn Treebank和Universal Dependencies等丰富的短语结构与依存标注资源,但缺乏大规模基于词法化语法形式化的语料库。为此,本文提出TAGbank,一个从现有句法树库自动提取的树邻接语法推导语料库。论文介绍了将短语结构标注映射为TAG推导的方法,利用TAG的生成能力支持解析、语法归纳与语义分析。该方法借鉴CCGbank的工作,扩展至捕捉TAG特有的结构特性,包括清晰的推导树和对长距离依赖的建模能力。同时讨论了提取过程中的挑战,如跨树库格式的一致性及语言特异性问题。未来计划扩展至多语言语料,重点包括Penn Korean和Penn Chinese Treebanks,探索TAG在跨语言场景中的应用。TAGbank旨在提供一个可靠的推导型资源,支持多种计算任务并促进对TAG生成能力的理论理解。

原文摘要 · Abstract (English)

The development of lexicalized grammars, particularly Tree-Adjoining Grammar (TAG), has significantly advanced our understanding of syntax and semantics in natural language processing (NLP). While existing syntactic resources like the Penn Treebank and Universal Dependencies offer extensive annotations for phrase-structure and dependency parsing, there is a lack of large-scale corpora grounded in lexicalized grammar formalisms. To address this gap, we introduce TAGbank, a corpus of TAG derivations automatically extracted from existing syntactic treebanks. This paper outlines a methodology for mapping phrase-structure annotations to TAG derivations, leveraging the generative power of TAG to support parsing, grammar induction, and semantic analysis. Our approach builds on the work of CCGbank, extending it to incorporate the unique structural properties of TAG, including its transparent derivation trees and its ability to capture long-distance dependencies. We also discuss the challenges involved in the extraction process, including ensuring consistency across treebank schemes and dealing with language-specific syntactic idiosyncrasies. Finally, we propose the future extension of TAGbank to include multilingual corpora, focusing on the Penn Korean and Penn Chinese Treebanks, to explore the cross-linguistic application of TAG's formalism. By providing a robust, derivation-based resource, TAGbank aims to support a wide range of computational tasks and contribute to the theoretical understanding of TAG's generative capacity.

语法形式化树邻接语法语料库构建自然语言处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。