用RoBERTa实现中文功能语法自动标注,首度打通理论与模型的桥梁。
A RoBERTa-Based Functional Syntax Annotation Model for Chinese Texts
- 基于罗伯特中文模型,结合功能语法理论构建标注框架。
- 在4100句人民日报语料上训练,命名实体识别F1达0.852。
- 首次将功能语法与注意力模型结合,适合语言学与NLP交叉研究者。
系统功能语法及其分支卡迪夫语法已在多种语言和文本中广泛应用于话语分析、语义功能研究等任务。然而,针对中文文本的功能语法自动标注系统尚未建立,严重制约了相关理论的应用与推广。为此,本研究基于RoBERTa(Robustly Optimized BERT Pretraining Approach)提出一种中文功能语法标注模型。研究从《人民日报》2014年语料中随机选取4,100个句子,依据功能语法理论进行标注,构建训练数据集。在此基础上,对RoBERTa-Chinese wwm-ext模型进行微调,完成命名实体识别任务,在测试集上取得0.852的F1分数,显著优于其他对比模型。模型在识别主语(S)、谓语(M)、补语(C)等核心句法成分方面表现优异。但对标签样本不平衡的实体仍存在提升空间。作为首个将功能语法与基于注意力机制的NLP模型融合的研究,本工作为中文功能语法自动化分析提供了新方法,奠定了后续研究基础。
原文摘要 · Abstract (English)
Systemic Functional Grammar and its branch, Cardiff Grammar, have been widely applied to discourse analysis, semantic function research, and other tasks across various languages and texts. However, an automatic annotation system based on this theory for Chinese texts has not yet been developed, which significantly constrains the application and promotion of relevant theories. To fill this gap, this research introduces a functional syntax annotation model for Chinese based on RoBERTa (Robustly Optimized BERT Pretraining Approach). The study randomly selected 4,100 sentences from the People's Daily 2014 corpus and annotated them according to functional syntax theory to establish a dataset for training. The study then fine-tuned the RoBERTa-Chinese wwm-ext model based on the dataset to implement the named entity recognition task, achieving an F1 score of 0.852 on the test set that significantly outperforms other comparative models. The model demonstrated excellent performance in identifying core syntactic elements such as Subject (S), Main Verb (M), and Complement (C). Nevertheless, there remains room for improvement in recognizing entities with imbalanced label samples. As the first integration of functional syntax with attention-based NLP models, this research provides a new method for automated Chinese functional syntax analysis and lays a solid foundation for subsequent studies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。