arXiv:2608.06607cs.CLcs.IR2026-08

用简单信号预判文档难易,动态选便宜或强模型,降本超70%。

Pre-Inference Routing for Cost-Efficient Document Field Extraction

论文配图:Pre-Inference Routing for Cost-Efficient Document Field Extraction
图 1 · 摘自论文原文
  • 先用图像质量等特征预判文档难度,再选低成本或高精度模型
  • 在收据上降本31%-33%,退化广告表单降本77%且准确率损失<0.02
  • 适合难读文档,对清晰数字发票无效,需为每数据集单独训练

多数文档提取系统对所有文档使用单一模型,虽简便但成本高且效果不均。本文研究能否通过廉价的文档特征(如图像质量、版式)预先判断文档难易,并据此选择更便宜或更强的提取器。实验发现,路由仅在两种条件同时满足时有效:廉价模型失败率足够高,且失败可由可见特征预测。基于此构建实用测试并应用于五类文档。当两条件满足时,校准后的路由器在收据上降低31%-33%成本,在退化广告表单上降低77%成本,同时保持F1值比始终使用大模型仅低0.02。若任一条件缺失(如清晰数字发票或易读营养标签),路由无益。小规模标注样本即可预测路由有效性,两次预实验预测均正确。简单词袋路由性能接近复杂特征设计,说明主要瓶颈在文档类型而非路由结构;使用可解释特征辅助判断哪些类型可路由。路由器需针对每个数据集重新训练,跨数据集不迁移,即使同类型亦然。该结论在成本差异为5倍和3倍的两组模型对中均成立。

原文摘要 · Abstract (English)

Most document-extraction systems use a single model for all documents. This is simple but can be costly for easy cases and less effective for difficult ones. We examine whether we can predict a document's difficulty before extraction using inexpensive, document-based signals, and use this to choose between a cheaper and a stronger extractor. We find that routing only helps if two conditions hold: the cheaper model fails often enough to make routing worthwhile, and those failures can be predicted from visible features such as image quality and layout. We turn these into a practical test and apply it to five genres. When both conditions are met, the calibrated router reduces cost by 31-33% on receipts and 77% on degraded ad-buy forms while keeping quality within 0.02 F1 of always choosing the large model. Routing does not help if either condition is missing, as with clean digital invoices or nutrition labels that are already easy to read. A small labeled pilot can predict whether routing will work, and in the two cases where we ran it first, the prediction was correct. A simple bag-of-words router works about as well as engineered features, showing that the main limit is the genre, not the router design; we use interpretable features to help explain which genres can be routed. The router must be retrained for each dataset and does not transfer across datasets, even within the same genre. These results hold for two model pairs with cost differences of 5x and 3x.

文档提取成本优化智能路由

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。