arXiv:2510.11813cs.SEcs.CL2025-10中稿 · presentation at th…被引 3

让大模型只关注关键信息,提升数据系统效率与可持续性

Task-Aware Reduction for Scalable LLM-Database Systems

  • 将输入文本缩减视为注意力分配,优先保留任务相关信号
  • 避免冗余文本输入,降低计算成本与环境负担
  • 适合需要高效处理海量日志、监控数据的系统设计者

大型语言模型在数据密集型任务(如数据库查询、开发可观测性)中应用日益广泛,但其效果受限于真实世界文本数据(如日志、遥测、监控流)的体量大、冗余多、噪声高。直接将此类数据输入大模型成本高昂且不环保,常与任务目标错配。现有优化多集中于模型或架构层面,上游输入冗余问题仍未受重视。本文主张将大模型的令牌预算视为注意力预算,将任务感知的文本缩减作为语言-数据系统的核心设计原则。我们提出,输入侧缩减不应是压缩,而是注意力分配:聚焦下游任务最相关的部分。我们指出了构建基准、设计自适应缩减流水线及在数据库和检索系统中集成令牌预算感知预处理等开放挑战。愿景是将稀缺的注意力资源引导至嘈杂数据流中的有意义信号,实现可扩展、准确且可持续的大模型-数据融合。

原文摘要 · Abstract (English)

Large Language Models (LLMs) are increasingly applied to data-intensive workflows, from database querying to developer observability. Yet the effectiveness of these systems is constrained by the volume, verbosity, and noise of real-world text-rich data such as logs, telemetry, and monitoring streams. Feeding such data directly into LLMs is costly, environmentally unsustainable, and often misaligned with task objectives. Parallel efforts in LLM efficiency have focused on model- or architecture-level optimizations, but the challenge of reducing upstream input verbosity remains underexplored. In this paper, we argue for treating the token budget of an LLM as an attention budget and elevating task-aware text reduction as a first-class design principle for language -- data systems. We position input-side reduction not as compression, but as attention allocation: prioritizing information most relevant to downstream tasks. We outline open research challenges for building benchmarks, designing adaptive reduction pipelines, and integrating token-budget--aware preprocessing into database and retrieval systems. Our vision is to channel scarce attention resources toward meaningful signals in noisy, data-intensive workflows, enabling scalable, accurate, and sustainable LLM--data integration.

大模型数据系统注意力分配降噪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。