让数据系统主动理解用户需求,用大模型智能重构查询与数据。
LLM-Powered Proactive Data Systems
- 数据系统不再被动执行指令,而是主动解析和重写用户输入
- 通过理解任务本质和数据特征,提升查询效率与结果准确性
- 适合需要智能交互与复杂推理的数据应用开发者
借助大模型(LLM)的能力,我们如今可以查询以往无法处理的文本、图像和视频数据。然而,当前大多数基于大模型的数据系统仍是被动响应型,将大模型视为黑箱处理用户输入,如同其他昂贵的近似函数(UDF)一样进行优化,未充分理解任务本质、数据特性或用户真实需求。这类系统难以应对长篇复杂文档中的模糊性与不精确性,也无法确保结果正确性。本文主张构建主动式数据系统:赋予系统更多自主权,使其能理解并重构用户请求与数据,灵活调整处理方式。通过解析、改写、分解输入,或突破单次查询的限制与用户交互,系统可更高效地满足实际需求。该范式拓展了数据系统的能动性设计空间,支持基于操作特性、数据特征与用户意图的智能优化。文中讨论多个真实应用场景的成功案例,并展望未来研究方向。
原文摘要 · Abstract (English)
With the power of LLMs, we now have the ability to query data that was previously impossible to query, including text, images, and video. However, despite this enormous potential, most present-day data systems that leverage LLMs are reactive, reflecting our community's desire to map LLMs to known abstractions. Most data systems treat LLMs as an opaque black box that operates on user inputs and data as is, optimizing them much like any other approximate, expensive UDFs, in conjunction with other relational operators. Such data systems do as they are told, but fail to understand and leverage what the LLM is being asked to do (i.e. the underlying operations, which may be error-prone), the data the LLM is operating on (e.g., long, complex documents), or what the user really needs. They don't take advantage of the characteristics of the operations and/or the data at hand, or ensure correctness of results when there are imprecisions and ambiguities. We argue that data systems instead need to be proactive: they need to be given more agency -- armed with the power of LLMs -- to understand and rework the user inputs and the data and to make decisions on how the operations and the data should be represented and processed. By allowing the data system to parse, rewrite, and decompose user inputs and data, or to interact with the user in ways that go beyond the standard single-shot query-result paradigm, the data system is able to address user needs more efficiently and effectively. These new capabilities lead to a rich design space where the data system takes more initiative: they are empowered to perform optimization based on the transformation operations, data characteristics, and user intent. We discuss various successful examples of how this framework has been and can be applied in real-world tasks, and present future directions for this ambitious research agenda.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。