让大模型学会根据作者意图精准改写文本,小数据也能高效训练。
Intention-Adaptive LLM Fine-Tuning for Text Revision Generation
- 按意图动态选择模型层进行微调,实现针对性学习。
- 在小规模改写语料上超越多种主流参数高效微调方法。
- 适合需要精准表达作者意图的文本改写场景。
大型语言模型(LLMs)在基于上下文的文本生成任务中表现卓越,如摘要生成和推理;然而其在基于意图的生成任务中应用仍不充分。以改写生成为例,要求生成文本明确体现作者的真实意图。由于意图复杂多变,识别意图并生成理想改写仍具挑战性。尽管已有研究采用少样本学习让LLM生成改写,但在多重纠缠意图场景下表现不佳。虽使用意图指令微调LLM前景可观,但需大量标注数据,而改写领域数据昂贵且稀缺。为此,我们提出Intention-Tuning,一种意图自适应的分层微调框架,可动态选择部分模型层学习意图,并将其表示迁移到改写生成中。实验表明,Intention-Tuning在小规模改写语料上表现优异且高效,优于多个PEFT基线方法。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have achieved impressive capabilities in various context-based text generation tasks, such as summarization and reasoning; however, their applications in intention-based generation tasks remain underexplored. One such example is revision generation, which requires the generated text to explicitly reflect the writer's actual intentions. Identifying intentions and generating desirable revisions are challenging due to their complex and diverse nature. Although prior work has employed LLMs to generate revisions with few-shot learning, they struggle with handling entangled multi-intent scenarios. While fine-tuning LLMs using intention-based instructions appears promising, it demands large amounts of annotated data, which is expensive and scarce in the revision community. To address these challenges, we propose Intention-Tuning, an intention-adaptive layer-wise LLM fine-tuning framework that dynamically selects a subset of LLM layers to learn the intentions and subsequently transfers their representations to revision generation. Experimental results suggest that Intention-Tuning is effective and efficient on small revision corpora, outperforming several PEFT baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。