提出新评估框架,让大模型文本增强更稳更准。
Iterative Augmentation with Summarization Refinement (IASR) Evaluation for Unstructured Survey data Modeling and Analysis
- 用迭代摘要精炼法检测多次改写中的语义漂移
- 在真实数据上使主题粒度提升400%,消除重叠
- 适合做低资源文本建模和增强效果评估的团队
文本数据增强是缓解自然语言处理中数据稀疏问题的常用策略,尤其在样本有限的低资源场景下。现有方法在大规模或迭代生成时缺乏语义一致性保障,易导致冗余与不稳定。本文提出一个基于大语言模型的文本增强原则性评估框架,包含两部分:(1) 可扩展性分析,衡量增广量增加时的语义一致性;(2) 迭代增强与摘要精炼(IASR),评估递归改写过程中的语义漂移。在多个主流LLM上的实证评估显示,GPT-3.5 Turbo在语义保真度、多样性与生成效率之间表现最优。将其应用于使用BERTopic和增强少样本标注的真实主题建模任务,实现主题粒度提升400%,完全消除主题重叠。结果验证了该框架在实际NLP流程中评估大模型增强技术的有效性。
原文摘要 · Abstract (English)
Text data augmentation is a widely used strategy for mitigating data sparsity in natural language processing (NLP), particularly in low-resource settings where limited samples hinder effective semantic modeling. While augmentation can improve input diversity and downstream interpretability, existing techniques often lack mechanisms to ensure semantic preservation during large-scale or iterative generation, leading to redundancy and instability. This work introduces a principled evaluation framework for large language model (LLM) based text augmentation, comprising two components: (1) Scalability Analysis, which measures semantic consistency as augmentation volume increases, and (2) Iterative Augmentation with Summarization Refinement (IASR), which evaluates semantic drift across recursive paraphrasing cycles. Empirical evaluations across state-of-the-art LLMs show that GPT-3.5 Turbo achieved the best balance of semantic fidelity, diversity, and generation efficiency. Applied to a real-world topic modeling task using BERTopic with GPT-enhanced few-shot labeling, the proposed approach results in a 400% increase in topic granularity and complete elimination of topic overlaps. These findings validated the utility of the proposed frameworks for structured evaluation of LLM-based augmentation in practical NLP pipelines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。