针对生物医学文本数据稀缺,提出基于推理的迭代增强方法。
WHERE and WHICH: Iterative Debate for Biomedical Synthetic Data Augmentation
- 引入生物关系相似性衡量,避免简单替换导致语义偏离。
- 多智能体反思机制迭代优化,防止相似实体误替换。
- 在9个数据集上一致提升性能,适合生物医学文本任务。
在生物医学自然语言处理任务中,如关系抽取、命名实体识别和文本分类,高质量数据稀缺仍是重大挑战。这会导致大模型无法正确理解生物实体间的关系(如分子与疾病、药物相互作用),进而引发对生物医学文献的误读。现有合成数据增强方法通常依赖词汇相似性进行替换,但常生成违背原意的反事实数据,破坏有意义的词语组合,难以提升模型表现。为此,本文提出一种面向生物医学领域的基于推理的合成数据增强方法。该方法不仅考虑词法相似性,更关注生物关系相似性,确保增强样本与原始语义密切相关。同时,引入多智能体参与的反思机制,通过迭代讨论区分相似实体的使用场景,避免误替换陷阱。我们在BLURB和BigBIO基准上评估了该方法,涵盖4类主流生物医学任务的9个常见数据集。实验结果表明,该方法在所有任务上均实现稳定性能提升,有效缓解数据稀缺问题,显著增强生物医学NLP模型的整体表现。
原文摘要 · Abstract (English)
In Biomedical Natural Language Processing (BioNLP) tasks, such as Relation Extraction, Named Entity Recognition, and Text Classification, the scarcity of high-quality data remains a significant challenge. This limitation poisons large language models to correctly understand relationships between biological entities, such as molecules and diseases, or drug interactions, and further results in potential misinterpretation of biomedical documents. To address this issue, current approaches generally adopt the Synthetic Data Augmentation method which involves similarity computation followed by word replacement, but counterfactual data are usually generated. As a result, these methods disrupt meaningful word sets or produce sentences with meanings that deviate substantially from the original context, rendering them ineffective in improving model performance. To this end, this paper proposes a biomedical-dedicated rationale-based synthetic data augmentation method. Beyond the naive lexicon similarity, specific bio-relation similarity is measured to hold the augmented instance having a strong correlation with bio-relation instead of simply increasing the diversity of augmented data. Moreover, a multi-agents-involved reflection mechanism helps the model iteratively distinguish different usage of similar entities to escape falling into the mis-replace trap. We evaluate our method on the BLURB and BigBIO benchmark, which includes 9 common datasets spanning four major BioNLP tasks. Our experimental results demonstrate consistent performance improvements across all tasks, highlighting the effectiveness of our approach in addressing the challenges associated with data scarcity and enhancing the overall performance of biomedical NLP models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。