arXiv:2504.10421cs.CLcs.AI2025-04EMNLP被引 4

现有方法难以有效编辑长尾生物医学知识,因一对多关系普遍导致效果受限。

Can We Edit LLMs for Long-Tail Biomedical Knowledge?

  • 针对长尾生物医学知识设计知识编辑策略
  • 编辑后长尾知识表现仍低于高频常见知识
  • 一对多关系是限制编辑效果的关键因素,适合研究者参考

知识编辑已成为更新大语言模型内部知识的有效方法。然而,在生物医学领域,由于知识分布呈长尾特性,罕见信息普遍存在,使得该方法面临独特挑战。本文首次全面研究知识编辑在长尾生物医学知识上的有效性。结果表明,尽管现有编辑方法能提升模型对长尾知识的表现,但其效果仍显著低于对高频流行知识的处理能力。进一步分析发现,长尾生物医学知识中存在大量一对多关系,即一个主体与关系关联多个对象。这种高频率的一对多结构限制了知识编辑在提升模型对长尾知识理解方面的能力,凸显了开发针对性策略的必要性。

原文摘要 · Abstract (English)

Knowledge editing has emerged as an effective approach for updating large language models (LLMs) by modifying their internal knowledge. However, their application to the biomedical domain faces unique challenges due to the long-tailed distribution of biomedical knowledge, where rare and infrequent information is prevalent. In this paper, we conduct the first comprehensive study to investigate the effectiveness of knowledge editing methods for editing long-tail biomedical knowledge. Our results indicate that, while existing editing methods can enhance LLMs' performance on long-tail biomedical knowledge, their performance on long-tail knowledge remains inferior to that on high-frequency popular knowledge, even after editing. Our further analysis reveals that long-tail biomedical knowledge contains a significant amount of one-to-many knowledge, where one subject and relation link to multiple objects. This high prevalence of one-to-many knowledge limits the effectiveness of knowledge editing in improving LLMs' understanding of long-tail biomedical knowledge, highlighting the need for tailored strategies to bridge this performance gap.

知识编辑长尾知识生物医学大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。