arXiv:2605.00336cs.CLcs.AI2026-05ACL

在有限令牌预算下,高效选择临床文本片段以降低大模型成本。

Budget-Aware Routing for Long Clinical Text

论文配图:Budget-Aware Routing for Long Clinical Text
图 1 · 摘自论文原文
  • 设计可单调增的子模目标函数,平衡相关性、覆盖与多样性。
  • 低预算时位置优先法最佳,高预算下多样性方法提升生成质量。
  • 聚类分段反而降低性能,选择器比分段方式更重要。

大语言模型面临查询的令牌成本与整体部署开销挑战。临床文本长而异构,常含冗余信息,而下游任务短且重要。本文研究受预算约束的上下文选择:在严格令牌预算下选取文档片段,使现成生成器满足固定成本与延迟要求。将此问题建模为带背包约束的子集选择,涉及两个设计选择:单元化(定义文档切分方式)与选择策略(决定保留哪些单元)。提出RCD目标函数,具有单调子模性,兼顾相关性、覆盖与多样性。对比句子、章节、窗口和聚类四种单元化方法,引入适应预算阶段的路由启发式。在MIMIC出院记录、Cochrane摘要和L-Eval数据集上实验表明,最优策略依赖评估场景:低预算下提取任务中位置启发式表现最佳;多样性方法如MMR改善大模型生成效果。选择器影响大于单元化,聚类分段降低性能,其他方案差异较小。ROUGE在大模型摘要中趋于饱和,而BERTScore更能反映质量差异。代码已开源。

原文摘要 · Abstract (English)

A key challenge for large language models is token cost per query and overall deployment cost. Clinical inputs are long, heterogeneous, and often redundant, while downstream tasks are short and high stakes. We study budgeted context selection, where a subset of document units is chosen under a strict token budget so an off-the-shelf generator can meet fixed cost and latency constraints. We cast this as a knapsack-constrained subset selection problem with two design choices, unitization that defines document segmentation and selection that determines which units are kept. We propose \textbf{RCD}, a monotone submodular objective that balances relevance, coverage, and diversity. We compare sentence, section, window, and cluster-based unitization, and introduce a routing heuristic that adapts to the budget regime. Experiments on MIMIC discharge notes, Cochrane abstracts, and L-Eval show that optimal strategies depend on the evaluation setting. Positional heuristics perform best at low budgets in extractive tasks, while diversity-aware methods such as MMR improve LLM generation. Selector choice matters more than unitization, with cluster-based grouping reducing performance and other schemes behaving similarly. ROUGE saturates for LLM summaries, while BERTScore better reflects quality differences. We release our code at https://github.com/stone-technologies/ACL_budget_paper.

临床文本预算优化大模型推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。