为中文医疗文本检索构建高质量基准,提出轻量高效异构检索模型。
Benchmarking and Enabling Efficient Chinese Medical Retrieval via Asymmetric Encoders

- 用轻量BERT处理查询,大模型处理文档,实现快速响应。
- 在自建基准上超越现有模型,精度更高且推理延迟不变。
- 专家验证标注质量,解决中文医疗检索数据稀缺问题。
高效医疗文本检索需兼顾高准确率与低延迟。尽管基于大语言模型的嵌入模型具备强大检索能力,但其高昂的计算成本和延迟限制了实时应用。此外,缺乏全面且高质量的基准也制约了中文医疗文本检索的发展。本文提出中文医疗文本嵌入基准(CMedTEB),涵盖检索、重排序和语义文本相似性(STS)三类实际任务。该基准通过多大模型投票并经临床专家验证的流程构建,确保标签质量并降低标注噪声。在此基础上,我们提出中文医疗异构检索器(CARE),采用轻量级BERT风格编码器在线处理查询,强大语言模型编码器离线处理文档。针对双结构编码器优化难题,设计两阶段训练策略逐步对齐查询与文档表示。大量实验表明,CARE在CMedTEB上优于现有对称模型,实现更高检索性能而无需增加推理延迟。
原文摘要 · Abstract (English)
Effective medical text retrieval requires both high accuracy and low latency. While LLM-based embedding models possess powerful retrieval capabilities, their prohibitive latency and high computational cost limit their application in real-time scenarios. Furthermore, the lack of comprehensive and high-fidelity benchmarks hinders progress in Chinese medical text retrieval. In this work, we introduce the Chinese Medical Text Embedding Benchmark (CMedTEB), a benchmark spanning three kinds of practical embedding tasks: retrieval, reranking, and semantic textual similarity (STS). Distinct from purely automated datasets, CMedTEB is curated via a rigorous multi-LLM voting pipeline validated by clinical experts, ensuring gold-standard label quality while effectively mitigating annotation noise. On this foundation, we propose the Chinese Medical Asymmetric REtriever (CARE), an asymmetric architecture that pairs a lightweight BERT-style encoder for online query encoding with a powerful LLM-based encoder for offline document encoding. However, optimizing such an asymmetric retriever with two structurally different encoders presents distinctive challenges. To address this, we introduce a novel two-stage training strategy that progressively bridges the query and document representations. Extensive experiments demonstrate that CARE surpasses state-of-the-art symmetric models on CMedTEB, achieving superior retrieval performance without increasing inference latency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。