用自生成数据让大模型精通表格任务,无需人工标注。
Table-LLM-Specialist: Language Model Specialists for Tables using Iterative Generator-Validator Fine-tuning
- 通过生成-验证迭代机制自动构造训练数据
- 小模型经微调后性能超越GPT-4,延迟更低
- 适合需要高效表格处理的工业级应用
如GPT和Llama等语言模型在多种自然语言任务中表现优异,但在复杂表格任务(如自然语言转代码、数据清洗)上表现仍不理想。传统提升方法依赖昂贵的人工标注,易过拟合。本文提出Table-LLM-Specialist,一种面向表格任务的自训练微调范式。核心思想是:许多表格任务存在生成与分类两种互补形式。基于此,我们设计生成-验证迭代框架,利用语言模型自动生成并验证训练数据,实现无需人工标注的有效微调。在Llama、GPT-3.5和GPT-4上的大量实验表明,Table-LLM-Specialist使微调后的模型在多任务上表现强劲——例如,基于GPT-3.5微调的模型常达到甚至超过GPT-4水平;同时降低部署成本,使小型模型以更低延迟和开销达成高质量;此外,由于训练数据来自真实世界表格且多样性高,模型具备更强跨基准泛化能力。代码已开源(https://github.com/microsoft/Table-Specialist)。经该方法微调的模型已集成至Microsoft Excel,并投入生产用于自动化表格数据清洗。
原文摘要 · Abstract (English)
Language models such as GPT and Llama have shown remarkable ability on diverse natural language tasks, yet their performance on complex table tasks (e.g., NL-to-Code and data cleaning) remains suboptimal. Improving performance typically requires task-specific fine-tuning, which depends on expensive human labeling and is prone to overfitting. In this work, we propose Table-LLM-Specialist, a self-trained fine-tuning paradigm designed for table tasks. Our key insight is that many table tasks admit two dual formulations: a generative version and a classification version. Leveraging this duality, we introduce a Generator-Validator paradigm that iteratively generates and validates training data using language models, enabling effective fine-tuning without manually labeled data. Extensive evaluations on Llama, GPT-3.5, and GPT-4 show that Table-LLM-Specialist achieves (1) strong performance across diverse tasks compared to base models, for example, models fine-tuned on GPT-3.5 often surpass GPT-4 level quality; (2) lower deployment cost by enabling smaller models to reach high quality with reduced latency and cost; and (3) better generalization across multiple benchmarks, due to training on diverse, systematically generated data from real-world tables. Our code is available at https://github.com/microsoft/Table-Specialist. Models fine-tuned with Table-LLM-Specialist have been integrated into Microsoft Excel and are deployed in production for automated table data cleaning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。