研究中文分词边界如何影响语法解析结构。
Parsing Through Boundaries in Chinese Word Segmentation
- 对比多种分词方案对句法结构的影响
- 基于GSD语料库发现分词方式显著改变依存关系
- 提供可视化工具便于分析不同分词效果
中文分词是自然语言处理的基础任务，对句法分析有深远影响。与英文等拼音语言不同，中文缺乏显式词边界，导致分词既必要又存在固有歧义。本研究揭示了分词与句法解析之间的复杂关系，明确了不同分词策略如何塑造中文的依存结构。聚焦中文GSD语料库，分析多种词边界方案，每种方案反映不同的语言学和计算假设，并考察其对生成句法结构的影响。为支持细致比较，引入一个交互式网络可视化工具，展示不同分词方法下的解析结果。
原文摘要 · Abstract (English)
Chinese word segmentation is a foundational task in natural language processing (NLP), with far-reaching effects on syntactic analysis. Unlike alphabetic languages like English, Chinese lacks explicit word boundaries, making segmentation both necessary and inherently ambiguous. This study highlights the intricate relationship between word segmentation and syntactic parsing, providing a clearer understanding of how different segmentation strategies shape dependency structures in Chinese. Focusing on the Chinese GSD treebank, we analyze multiple word boundary schemes, each reflecting distinct linguistic and computational assumptions, and examine how they influence the resulting syntactic structures. To support detailed comparison, we introduce an interactive web-based visualization tool that displays parsing outcomes across segmentation methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。