arXiv:2605.11774cs.CLcs.LG2026-05

将医学术语对合并为新标记,实现无损压缩并提速34%-63%

From Token to Token Pair: Efficient Prompt Compression for Large Language Models in Clinical Prediction

论文配图:From Token to Token Pair: Efficient Prompt Compression for Large Language Models in Clinical Prediction
图 1 · 摘自论文原文
  • 通过识别频繁共现的医学词对,合并为复合标记
  • 输入长度减少31%,推理延迟降低34%-63%,性能不降反升
  • 仅微调0.5%-1.0%参数,适配多任务、多语言临床预测

将电子健康记录(EHR)作为自然语言序列处理,大语言模型(LLM)在死亡率预测和表型分类等临床预测任务中展现出潜力。然而,长期或高频的EHR常导致令牌序列过长,带来高计算成本甚至性能下降。现有方法或增加压缩模块,或删减次要令牌,均引入额外推理延迟或损失临床信息。为此,我们提出医学词对编码(MedTPE),一种分层式扩展标准分词的方法。MedTPE将频繁共现的医疗词对合并为复合标记,在依赖感知替换策略下实现无损压缩,同时保持计算复杂度。仅需对新引入标记的嵌入进行自监督学习,微调0.5%-1.0%的LLM参数。在真实世界数据集上的两项临床场景实验表明,MedTPE可将输入令牌长度减少最高31%,推理延迟降低34%-63%,并在多个LLM与四项临床预测任务中维持或提升预测性能及输出格式合规性。此外,MedTPE在不同上下文长度下表现稳健,且具备跨科学、金融领域及多语言的泛化能力。

原文摘要 · Abstract (English)

By processing electronic health records (EHRs) as natural language sequences, large language models (LLMs) have shown potential in clinical prediction tasks such as mortality prediction and phenotyping. However, longitudinal or highly frequent EHRs often yield excessively long token sequences that result in high computational costs and even reduced performance. Existing solutions either add modules for compression or remove less important tokens, which introduce additional inference latency or risk losing clinical information. To achieve lossless compression of token sequences without additional cost or loss of performance, we propose Medical Token-Pair Encoding (MedTPE), a layered method that extends standard tokenisation for EHR sequences. MedTPE merges frequently co-occurring medical token pairs into composite tokens, providing lossless compression while preserving the computational complexity through a dependency-aware replacement strategy. Only the embeddings of the newly introduced tokens of merely 0.5-1.0% of the LLM's parameters are fine-tuned via self-supervised learning. Experiments on real-world datasets for two clinical scenarios demonstrate that MedTPE reduces input token length by up to 31% and inference latency by 34-63%, while maintaining or even improving both predictive performance and output format compliance across multiple LLMs and four clinical prediction tasks. Furthermore, MedTPE demonstrates robustness across different input context lengths and generalisability to scientific and financial domains and different languages.

医学AI提示压缩LLM优化临床预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。