让大模型指令微调更贴合实际任务,提升真实场景表现。
TCIA: A Task-Centric Instruction Augmentation Method for Instruction Finetuning
- 用离散查询-约束空间生成任务相关的多样化指令
- 在4个真实任务中平均提升8.7%性能,部分超越闭源模型
- 适合需要精准落地的工业级AI应用开发
多样化的指令数据对大语言模型的有效指令微调至关重要,有助于模型泛化到不同输入类型。构建此类多样化指令数据集是关键步骤。现有方法常利用大语言模型自动探索并生成多样化指令,确保数据多样性与质量,但往往忽视了真实应用场景中的一个重要因素:任务相关性。实践中,仅有少数应用需要真正通用的模型;多数场景更受益于针对特定使用场景的任务知识定制。因此,亟需开发既保持多样性又优化特定现实场景的指令增强方法。为此,本文提出任务中心指令增强(TCIA),一种系统化扩展指令的同时保持多样性与任务对齐的框架。通过将指令表示为离散的查询-约束空间,TCIA生成丰富且任务相关的指令,使模型能在不牺牲整体性能的前提下泛化至任务特定指令。实验表明,TCIA在四个真实世界、任务特定的应用中,使开源LLM平均性能提升8.7%,某些情况下甚至超过领先闭源模型。这些改进未影响通用指令遵循能力,证明TCIA是适配大模型至真实、任务导向应用的可扩展且高效方案。
原文摘要 · Abstract (English)
Diverse instruction data is vital for effective instruction tuning of large language models, as it enables the model to generalize across different types of inputs . Building such diversified instruction dataset is an essential step in this process. Existing approaches often leverage large language models to automatically explore and generate diverse instructions, ensuring both data diversity and quality. However, they tend to overlook an important factor in real-world applications: on-task relevance. In practice, only a few real-world applications require a truly general-purpose model; most benefit from task-specific knowledge tailored to their particular use case. Therefore, it is vital to develop instruction augmentation methods that not only maintain diversity but are also optimized for specific, real-world scenarios. We thus introduce Task Centric Instruction Augmentation (TCIA), a framework that systematically expands instructions while preserving both diversity and task alignment. By representing instructions in a discrete query-constraints space, TCIA creates a rich set of task-relevant instructions and enables models to generalize to these task-specific instructions without sacrificing overall performance. Experiments show that TCIA improves open-source LLMs' performance by an average of 8.7% across four real-world, task-specific applications, and in some cases outperforming leading closed-source models. These improvements do not compromise general instruction-following ability, making TCIA a scalable and efficient solution for adapting LLMs to real-world, task-focused applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。