arXiv:2508.14723cs.CLcs.AI2025-08EMNLP被引 1

用大模型生成新文本,保留原意同时更富创意。

Transplant Then Regenerate: A New Paradigm for Text Data Augmentation

  • 将原文植入大模型扩展上下文,再让模型重写生成新版本。
  • 在多个任务中表现优于传统方法,且数据量越大效果越明显。
  • 适合需要多样化训练数据的自然语言处理研究者使用。

数据增强是深度学习中的关键技术。传统方法如反向翻译主要在词汇层面改写,仅生成语义相同的变化。尽管大语言模型(LLMs)凭借其“知识涌现”能力提升了文本增强效果,但控制输出风格和结构仍具挑战性,需精细提示工程。本文提出一种名为LMTransplant的新范式,利用大模型实现文本增强。核心思路为“移植-重生成”:将原始文本嵌入由大模型扩展的上下文中,并要求模型基于扩展上下文生成新变体。该策略可充分调动大模型内嵌知识,生成更具多样性与创造性的内容级变体,同时保持原文核心属性。我们在多种文本任务上评估了LMTransplant,结果表明其性能显著优于现有方法。此外,随着增广数据规模增长,该方法展现出卓越的可扩展性。

原文摘要 · Abstract (English)

Data augmentation is a critical technique in deep learning. Traditional methods like Back-translation typically focus on lexical-level rephrasing, which primarily produces variations with the same semantics. While large language models (LLMs) have enhanced text augmentation by their "knowledge emergence" capability, controlling the style and structure of these outputs remains challenging and requires meticulous prompt engineering. In this paper, we propose LMTransplant, a novel text augmentation paradigm leveraging LLMs. The core idea of LMTransplant is transplant-then-regenerate: incorporating seed text into a context expanded by LLM, and asking the LLM to regenerate a variant based on the expanded context. This strategy allows the model to create more diverse and creative content-level variants by fully leveraging the knowledge embedded in LLMs, while preserving the core attributes of the original text. We evaluate LMTransplant across various text-related tasks, demonstrating its superior performance over existing text augmentation methods. Moreover, LMTransplant demonstrates exceptional scalability as the size of augmented data grows.

文本增强大模型生成式

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。