无需外部标注,用自监督方法高效适配小规模知识库问答模型。
KBAlign: Efficient Self Adaptation on Specific Knowledge Bases
- 通过多粒度自标注构建数据,利用模型自身能力对齐知识。
- 仅用小模型自标注即可达到GPT-4监督效果的90%性能。
- 适合资源受限场景下需深度整合专业文本的问答系统。
尽管检索增强生成(RAG)在基于知识的问答(KBQA)中仍至关重要,但在特定领域仍面临严峻挑战。现有方法在小规模知识库上的定向适配困难:纯无监督训练效果差,微调又需高昂的外部信号成本。我们提出KBAlign,一种自监督框架,通过高效模型适配提升RAG系统性能。核心思想是利用模型内在知识对齐能力,引入两种创新机制:多粒度自标注用于构建数据,捕捉全局知识;迭代调优通过自验证加速收敛。该框架实现低成本适配特定文本知识库,无需人工标注或外部模型支持。实验表明,KBAlign仅依赖小模型自标注,即可达成GPT-4监督适配90%的性能增益。在多个领域显著提升下游问答准确率,尤其适用于需要从专业语料中深度整合知识的场景。我们已公开实验数据、模型及过程分析(https://github.com/thunlp/KBAlign),供社区进一步探索。
原文摘要 · Abstract (English)
Although retrieval-augmented generation (RAG) remains essential for knowledge-based question answering (KBQA), current paradigms face critical challenges under specific domains. Existing methods struggle with targeted adaptation on small-scale KBs: vanilla unsupervised training exhibits poor effectiveness, while fine-tuning incurs prohibitive costs of external signals. We present KBAlign, a self-supervised framework that enhances RAG systems through efficient model adaptation. Our key insight is to leverage the model's intrinsic capabilities for knowledge alignment through two innovative mechanisms: multi-grained self-annotation that captures global knowledge for data construction, and iterative tuning that accelerates convergence through self verification. This framework enables cost-effective model adaptation to specific textual KBs, without human supervision or external model assistance. Experiments demonstrate that KBAlign can achieve 90\% of the performance gain obtained through GPT-4-supervised adaptation, while relying entirely on self-annotation of much smaller models. KBAlign significantly improves downstream QA accuracy across multiple domains with tiny costs, particularly benefiting scenarios requiring deep knowledge integration from specialized corpora. We release our experimental data, models, and process analyses to the community for further exploration (https://github.com/thunlp/KBAlign).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。