arXiv:2605.30529cs.CLcs.AI2026-05

用大模型生成数据,提升非英语医学检索效果。

Generalistic or Specific Embeddings, Which is Better? An Empirical Study on Search for Clinical Coding in Non-English Languages

论文配图:Generalistic or Specific Embeddings, Which is Better? An Empirical Study on Search for Clinical Coding in Non-English Languages
图 1 · 摘自论文原文
  • 用大模型生成多语言医学数据,训练双阶段检索器。
  • 在五种语言中,最高达R@5=0.829,超越基准模型。
  • 提供可复现的构建方案,适合医疗信息检索研究者。

面向临床编码的语义检索,当前的句子嵌入模型主要集中于英文数据集,应用于其他语言时召回率显著下降,且常被整体指标掩盖。本文探索利用大语言模型作为数据生成工厂,填补这一空白。研究构建了一个两阶段检索器(双编码器+交叉编码器重排序),基于西班牙语生物医学编码器(PlanTL-GOB-ES/bsc-bio-ehr-es)在谷歌生成的合成数据上进行微调,覆盖英语、西班牙语、加泰罗尼亚语、意大利语、葡萄牙语和法语。结果表明,仅双编码器即在MRR(0.876 vs. 0.866)上持平,且在R@3(0.650 vs. 0.626)与R@5(0.804 vs. 0.790)上超越基线,无需英文生物医学预训练。加入交叉编码器后,平均R@5提升至0.822,在四类语言中表现更优(西班牙语+0.017,加泰罗尼亚语+0.033,法语+0.018,葡萄牙语+0.037),仅英语略有下降。临床可接受:葡萄牙语达R@5=0.829,远超BioBERT-ST的0.714。贡献包括:开放的领域专用检索器构建流程;量化学习增益(MRR从0.755升至0.876,+15.9%,约19,500个合成样本);以及各语言与排名层级的性能分布分析。

原文摘要 · Abstract (English)

Sentence-embedding models for semantic search are overwhelmingly developed and evaluated on English corpora. When applied to clinical retrieval in other languages -- particularly retrieval of ICD-10-CM / CIE-10 codes -- recall degrades in ways often masked by aggregate benchmarks. We study whether large generative language models can serve as data factories to close this gap. We build a two-stage retriever (bi-encoder followed by cross-encoder reranker), fine-tuned from a Spanish biomedical encoder (PlanTL-GOB-ES/bsc-bio-ehr-es) on Gemini-generated synthetic data covering English, Spanish, Catalan, Italian, Portuguese and French, and evaluate against BioBERT-ST and the un-tuned Spanish encoder. The bi-encoder alone matches BioBERT-ST on MRR (0.876 vs. 0.866) and overtakes it on R@3 (0.650 vs. 0.626) and R@5 (0.804 vs. 0.790) without English biomedical pretraining. Adding a cross-encoder reranker lifts aggregate R@5 to 0.822 and dominates on four of five languages (+0.017 Spanish, +0.033 Catalan, +0.018 French, +0.037 Portuguese) at the cost of a small English regression. The trade-off is clinically acceptable: Portuguese reaches R@5 = 0.829 vs. BioBERT-ST's 0.714. Contributions: an open recipe for building domain-specific medical retrievers from LLM-generated data; quantification of the learning gain (MRR 0.755 to 0.876, +15.9% with ~19,500 synthetic pairs); and a characterisation of where gains concentrate by language and rank.

医学检索多语言生成数据嵌入模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。