对比特征工程与深度学习,发现传统方法在中文医学文献章节识别中更优。
Feature engineering vs. deep learning for paper section identification: Toward applications in Chinese medical literature
- 结合词袋、词性、标题等特征,用条件随机场建模句子依赖关系
- 在哮喘文献数据集上达到近90%的精确率和召回率
- 适用于中文医学文献知识提取,对临床研究者有实用价值
章节识别是图书馆学与知识管理的重要任务,有助于过滤实体与关系抽取中的噪声。本研究聚焦中文医学文献的章节识别问题,关注对医生而言更具价值的‘对象’‘方法’‘结果’等部分。基于英文文献研究经验,实验验证了经典机器学习算法在结合词袋、词性、标题等多种特征时的有效性。结果表明,考虑句子依赖关系的条件随机场(CRF)优于通用深度学习模型。据此设计了结构化双向长短期记忆(SLSTM)模型,同时建模词语与句子的依赖关系及上下文信息。在人工标注的哮喘文献数据集上,该方法优于传统机器学习与其它深度学习方法,实现接近90%的精确率与召回率,展现出在其他文本挖掘任务中的潜力。研究具有重要的方法论与实践意义。
原文摘要 · Abstract (English)
Section identification is an important task for library science, especially knowledge management. Identifying the sections of a paper would help filter noise in entity and relation extraction. In this research, we studied the paper section identification problem in the context of Chinese medical literature analysis, where the subjects, methods, and results are more valuable from a physician's perspective. Based on previous studies on English literature section identification, we experiment with the effective features to use with classic machine learning algorithms to tackle the problem. It is found that Conditional Random Fields, which consider sentence interdependency, is more effective in combining different feature sets, such as bag-of-words, part-of-speech, and headings, for Chinese literature section identification. Moreover, we find that classic machine learning algorithms are more effective than generic deep learning models for this problem. Based on these observations, we design a novel deep learning model, the Structural Bidirectional Long Short-Term Memory (SLSTM) model, which models word and sentence interdependency together with the contextual information. Experiments on a human-curated asthma literature dataset show that our approach outperforms the traditional machine learning methods and other deep learning methods and achieves close to 90% precision and recall in the task. The model shows good potential for use in other text mining tasks. The research has significant methodological and practical implications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。