用提示增强+低秩微调,让大模型更稳地识别表格字段类型。
Robust LLM-based Column Type Annotation via Prompt Augmentation with LoRA Tuning
- 通过提示增强生成多样数据,结合LoRA低参数微调。
- 在多个数据集上保持稳定性能,加权F1优于单一提示微调。
- 适合需要快速适配新表格场景的开发者使用。
列类型标注(CTA)是实现表格模式对齐和语义理解的关键步骤。现有仅编码器的语言模型在标注数据上微调后表现优异,但仅限于域内场景,当表格分布或标签空间发生变化时需重新训练。近期工作尝试将CTA建模为多选任务并使用生成式大模型提示,但面临两个挑战:(1) 模型性能对提示词细微变化敏感;(2) 标注F1分数仍不理想。直接微调大模型虽可行,但因模型规模庞大,计算成本过高,且提示敏感性未消除。本文提出一种基于提示增强与低秩适配(LoRA)的参数高效框架,在提示增强数据上进行微调。该方法缓解了对提示变化的敏感性,大幅减少可训练参数,实现了跨数据集和提示模板的鲁棒性能。在多个最新基准测试中,使用该策略微调的模型在推理阶段对不同提示模式保持稳定,加权F1得分高于单提示模板微调模型。结果表明,参数高效训练与数据增强策略在构建实用、可适应的CTA系统中具有显著有效性。
原文摘要 · Abstract (English)
Column Type Annotation (CTA) is a fundamental step towards enabling schema alignment and semantic understanding of tabular data. Existing encoder-only language models achieve high accuracy when fine-tuned on labeled columns, but their applicability is limited to in-domain settings, as distribution shifts in tables or label spaces require costly re-training from scratch. Recent work has explored prompting generative large language models (LLMs) by framing CTA as a multiple-choice task, but these approaches face two key challenges: (1) model performance is highly sensitive to subtle changes in prompt wording and structure, and (2) annotation F1 scores remain modest. A natural extension is to fine-tune large language models. However, fully fine-tuning these models incurs prohibitive computational costs due to their scale, and the sensitivity to prompts is not eliminated. In this paper, we present a parameter-efficient framework for CTA that trains models over prompt-augmented data via Low-Rank Adaptation (LoRA). Our approach mitigates sensitivity to prompt variations while drastically reducing the number of necessary trainable parameters, achieving robust performance across datasets and templates. Experimental results on recent benchmarks demonstrate that models fine-tuned with our prompt augmentation strategy maintain stable performance across diverse prompt patterns during inference and yield higher weighted F1 scores than those fine-tuned on a single prompt template. These results highlight the effectiveness of parameter-efficient training and augmentation strategies in developing practical and adaptable CTA systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。