通过分步推理与并行扩展,让大模型更快更准地回答复杂问题。
Improving LLM Reasoning via Dependency-Aware Query Decomposition and Logic-Parallel Content Expansion
- 将复杂问题拆解为关键点生成与逻辑并行扩展两阶段
- 相比基线提速4.33倍,延迟降低3.42倍,准确率提升18.75%
- 适合需要低延迟高精度的实时对话与搜索系统
将大语言模型(LLMs)集成到实时网络应用(如AI搜索、对话代理)面临核心挑战:既要高质量复杂推理,又要满足低延迟、高吞吐的交互需求。现有方法受限于计算低效的串行生成和僵化的推理策略,难以兼顾效率与质量。为此,我们提出Orion框架,实现依赖感知的查询分解与逻辑并行内容扩展。具体而言,Orion将单个查询推理分为两个协同阶段:(1) 关键点生成——通过检索增强的少样本提示提炼出逻辑结构化关键点;(2) 内容并行扩展——基于依赖图并行展开这些关键点以保证逻辑一致性。此外,Orion引入流水线调度机制,利用两阶段计算特性(生成依赖GPU算力,扩展依赖显存)在多个查询间实现交叉并行,显著提升推理性能。在多个基准测试中,Orion不仅达到最高4.33倍的词元生成速度提升和3.42倍的答案延迟降低,还通过显式建模点间依赖,使推理质量提升最高达18.75%。
原文摘要 · Abstract (English)
The integration of Large Language Models (LLMs) into real-time Web applications, such as AI-powered search and conversational agents, presents a fundamental Web infrastructure challenge: reconciling the demand for high-quality, complex reasoning with the stringent low-latency and high-throughput requirements of interactive services. Current LLM reasoning, hindered by computationally inefficient sequential generation and rigid reasoning strategies, creates a critical bottleneck for the Web services. Existing approaches typically optimize the LLM reasoning for either efficiency or quality but struggle to achieve both, and thus fail to meet the dual requirements of modern Web platforms. To overcome these limitations, we propose Orion, a novel and efficient reasoning framework that enables dependency-aware query decomposition and logic-parallel content expansion. Concretely, Orion decomposes a single query reasoning process into two synergistic phases: (1) \textit{key point generation}, which distills logically structured key points through retrieval-augmented few-shot prompting, and (2) \textit{content parallel expansion}, which concurrently elaborates on these points based on a dependency graph to ensure logical consistency. Furthermore, Orion introduces a pipeline scheduling mechanism that exploits the complementary computational characteristics of the two phases (generation imposes pressure on GPU computing and expansion stresses on GPU memory) across multiple queries, enabling cross-query parallelism and dramatically improving reasoning performance (\ie, efficiency and quality). Experiments on diverse benchmarks show that Orion not only delivers up to 4.33x higher token generation speed and 3.42x lower answer latency over the baselines but also improves reasoning quality by up to 18.75% through explicitly modeling inter-point dependencies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。