arXiv:2512.20012eess.SPcs.LG2025-12被引 2

用统计方法优化电信知识系统中大模型的分级响应,降低成本同时保证可靠。

Reliable LLM-Based Edge-Cloud-Expert Cascades for Telecom Knowledge Systems

  • 通过多假设检验确定阈值,自动判断问题该由边缘、云端还是专家处理
  • 在TeleQnA数据集上,成本比传统方法低30%以上,且错误率可控
  • 适合需要高可靠性又想节省算力的电信运维场景

大型语言模型(LLMs)正成为电信领域自动化的重要工具,用于故障排查、标准解读和网络优化等任务。然而实际部署需权衡推理成本、延迟与可靠性。本文研究一种基于边缘-云-专家级联的LLM知识系统,通过问答流程支持决策:边缘模型处理常规问题,云端模型应对复杂情况,仅在必要时引入人工专家。我们定义了一个对齐-成本约束的优化问题,目标是在最小化平均处理成本的同时,确保自动化答案与专家判断的一致性。提出一种基于多重假设检验(MHT)的统计严谨阈值选择方法,用于基于知识和置信度测试的查询处理机制,提供有限样本下的误对齐风险保证。在专用于电信领域的TeleQnA数据集上的实验表明,所提方法相比传统级联基线具有更优的成本效率,同时在指定置信水平下保持可靠性。

原文摘要 · Abstract (English)

Large language models (LLMs) are emerging as key enablers of automation in domains such as telecommunications, assisting with tasks including troubleshooting, standards interpretation, and network optimization. However, their deployment in practice must balance inference cost, latency, and reliability. In this work, we study an edge-cloud-expert cascaded LLM-based knowledge system that supports decision-making through a question-and-answer pipeline. In it, an efficient edge model handles routine queries, a more capable cloud model addresses complex cases, and human experts are involved only when necessary. We define a misalignment-cost constrained optimization problem, aiming to minimize average processing cost, while guaranteeing alignment of automated answers with expert judgments. We propose a statistically rigorous threshold selection method based on multiple hypothesis testing (MHT) for a query processing mechanism based on knowledge and confidence tests. The approach provides finite-sample guarantees on misalignment risk. Experiments on the TeleQnA dataset -- a telecom-specific benchmark -- demonstrate that the proposed method achieves superior cost-efficiency compared to conventional cascaded baselines, while ensuring reliability at prescribed confidence levels.

大模型电信系统级联推理可靠性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。