让抽取系统自我进化,边用边变聪明。
A Dynamic Self-Evolving Extraction System
- 用大模型逐步构建可自扩展的知识库,实现动态更新。
- 知识库通过概率推理和图计算不断积累领域概念与关系。
- 知识反哺模型,形成提取与认知相互提升的闭环。
从原始文本中提取结构化信息是文档检索、排序和相关性估计等NLP应用的基础。高质量的提取需具备领域特定精度、对专业术语体系的实时理解,以及对新兴术语和罕见异常值的识别能力。在医疗、法律、人力资源等领域,模型还需适应术语变化,并基于结构化知识进行显式推理。我们提出DySECT——一种动态自演化抽取与整理工具包,系统在使用过程中持续优化。它通过大模型增量式地向通用且可自扩展的知识库(KB)中填充三元组。该知识库进一步通过概率知识融合与基于图的推理机制自我丰富,逐步积累领域概念与关系。经增强的知识库通过提示调优、相关少样本示例采样或基于知识库生成的合成数据微调,反向反馈至大模型抽取器。由此形成一个共生闭环:抽取持续改进知识,知识亦持续提升抽取性能。
原文摘要 · Abstract (English)
The extraction of structured information from raw text is a fundamental component of many NLP applications, including document retrieval, ranking, and relevance estimation. High-quality extractions often require domain-specific accuracy, up-to-date understanding of specialized taxonomies, and the ability to incorporate emerging jargon and rare outliers. In many domains--such as medical, legal, and HR--the extraction model must also adapt to shifting terminology and benefit from explicit reasoning over structured knowledge. We propose DySECT, a Dynamic Self-Evolving Extraction and Curation Toolkit, which continually improves as it is used. The system incrementally populates a versatile, self-expanding knowledge base (KB) with triples extracted by the LLM. The KB further enriches itself through the integration of probabilistic knowledge and graph-based reasoning, gradually accumulating domain concepts and relationships. The enriched KB then feeds back into the LLM extractor via prompt tuning, sampling of relevant few-shot examples, or fine-tuning using KB-derived synthetic data. As a result, the system forms a symbiotic closed-loop cycle in which extraction continuously improves knowledge, and knowledge continuously improves extraction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。