arXiv:2608.30224cs.CLcs.AI2026-08

用智能路由降低电商大模型标注成本,自动判断何时用模型、何时人工介入。

The Differential Reasoning Router: Operationalizing Cost-Aware LLM Annotation in E-commerce

  • 按样本和规则双维度评估模型成功率,动态分配处理方式。
  • 在保持准确率的前提下,推理令牌成本降低60%以上。
  • 适合需要低成本冷启动的电商结构化数据标注场景。

大型语言模型(LLMs)在电商领域被广泛用于标注结构化商品数据,但初期部署常面临冷启动问题:预发布标签有限,昂贵推理的价值未知,系统需经人工审核才能大规模信任。这一挑战在基于规则的标注流程中尤为突出,因每条数据需满足多项业务规则,且模型错误与规则边界模糊性均影响最终决策。本文提出差分推理路由器(DRR),一个面向冷启动的低成本感知标注框架,联合优化模型选择与人工升级策略。不同于将推理模型作为默认后备,DRR分别估算直接模型与推理模型在样本及业务规则层面的成功概率,实现自适应路由:简单案例直接处理,推理仅用于预期能提升决策的情况,而高风险双重失败或规则冲突案例则转交人工。生成的标注数据可用于提示工程、监督微调、校准及规则优化,推动从人力密集型冷启动向高置信度自动化路由渐进演进。在实际电商工作流中,DRR达到与最强置信度路由相当的准确率,同时推理令牌成本降低超60%。

原文摘要 · Abstract (English)

Large Language Models (LLMs) are increasingly used to annotate structured product data in e-commerce, but early deployment often begins as a cold-start problem: only limited pre-launch labels are available, the value of expensive reasoning is unknown, and human review is needed before the system can be trusted at scale. This challenge is especially common in rule-based annotation workflows, where each item must satisfy multiple business rules and both model errors and ambiguous rule boundaries affect final decisions. We introduce the Differential Reasoning Router (DRR), a cost-aware framework for cold-start LLM annotation that jointly optimizes model selection and human escalation. Rather than treating a reasoning model as a default fallback, DRR estimates separate success probabilities for a direct model and a reasoning model at both the sample and business-rule levels, enabling adaptive routing: easy cases are handled directly, reasoning is reserved for cases where it is expected to improve the decision, and likely double-failure or rule-disagreement cases are escalated to human annotators. The resulting labels provide targeted ground truth for prompt engineering, supervised fine-tuning, calibration, and rule refinement, enabling a gradual shift from human-heavy cold-start annotation toward high-confidence automated routing. In a production e-commerce workflow, DRR reaches accuracy parity with the strongest confidence-based router while achieving more than 60\% reasoning-token cost savings.

大模型应用成本优化电商标注智能路由

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。