用大模型指导小模型,高效完成大规模知识挖掘。
A Tale of LLMs and Induced Small Proxies: Scalable Small Language Models for Knowledge Mining
- 大模型规划任务并生成标注,训练轻量代理模型。
- 推理成本降低90%,大规模知识挖掘提速20倍以上。
- 适合需要高效部署的智能搜索与知识系统。
深度研究的核心是知识挖掘,即从海量非结构化文本中提取结构化信息以响应用户指令。大语言模型(LLMs)在理解指令方面表现优异,但难以大规模部署;传统分类器与抽取器虽高效却脆弱且无法泛化。我们提出Falconer框架,融合大模型的智能规划与轻量代理模型,实现可扩展的知识挖掘。在Falconer中,大模型充当规划者,将用户指令分解为可执行流程;同时作为标注者,生成监督信号训练小型代理模型。该框架将分类与抽取统一为“获取标签”和“获取跨度”两种原子操作,使单一指令遵循模型替代多个专用组件。为评估代理模型与人工及大模型标注的一致性,我们构建了涵盖规划与端到端执行的新基准。实验表明,Falconer在指令遵循准确率上接近顶尖大模型,推理成本降低高达90%,大规模知识挖掘加速超过20倍,为深度研究提供了高效可扩展的基础。
原文摘要 · Abstract (English)
At the core of Deep Research is knowledge mining, the task of extracting structured information from massive unstructured text in response to user instructions. Large language models (LLMs) excel at interpreting such instructions but are prohibitively expensive to deploy at scale, while traditional pipelines of classifiers and extractors remain efficient yet brittle and unable to generalize to new tasks. We introduce Falconer, a collaborative framework that combines the agentic reasoning of LLMs with lightweight proxy models for scalable knowledge mining. In Falconer, LLMs act as planners, decomposing user instructions into executable pipelines, and as annotators, generating supervision to train small proxies. The framework unifies classification and extraction into two atomic operations, get label and get span, enabling a single instruction-following model to replace multiple task-specific components. To evaluate the consistency between proxy models incubated by Falconer and annotations provided by humans and large models, we construct new benchmarks covering both planning and end-to-end execution. Experiments show that Falconer closely matches state-of-the-art LLMs in instruction-following accuracy while reducing inference cost by up to 90% and accelerating large-scale knowledge mining by more than 20x, offering an efficient and scalable foundation for Deep Research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。