让AI理解复杂多源数据查询,支持跨模态推理与动态结果合成。
Blue Data Intelligence Layer: Streaming Data and Agents for Multi-source Multi-modal Data-Centric Applications

- 构建统一数据注册表,将LLM、网络和用户都视为可查询数据源
- 通过可执行查询计划分解复杂问题,实现多源异构数据融合
- 适合需要跨系统、跨模态交互的企业级智能应用开发者
NL2SQL系统旨在满足自然语言与数据交互的需求。然而,真实场景中的信息很少能用单一SQL查询表达,原因包括:(1) 用户提问具有迭代性;(2) 查询常跨越单个数据库的封闭世界,涉及多个数据源;(3) 常依赖常识或外部知识。因此,满足实际需求需整合异构数据源、多模态信息与上下文。本文提出蓝系统的数据智能层(DIL),用于支持多源、多模态、以数据为中心的应用。蓝是一个复合型AI系统,协调代理与数据处理企业级任务。DIL作为智能数据处理层,通过统一结构化企业数据、通过LLM获取的世界知识以及交互获得的个人上下文,弥合用户意图与可用信息之间的语义鸿沟。核心是数据注册表,存储多种数据源与模态的元数据,支持原生与自然语言查询。DIL将LLMs、网络和用户视作第一类数据源,各自拥有独立查询接口。查询规划器负责将用户查询转化为可执行查询计划,这些计划是关系操作与其他跨模态操作的声明式抽象。规划器支持复杂请求的分解、多源检索及最终结果的推理与集成。我们在两个交互场景中验证了DIL,展示用户查询如何动态触发多源检索、跨模态推理与结果合成,证明复合型AI系统可超越单一数据库的NL2SQL范式。
原文摘要 · Abstract (English)
NL2SQL systems aim to address the growing need for natural language interaction with data. However, real-world information rarely maps to a single SQL query because (1) users express queries iteratively (2) questions often span multiple data sources beyond the closed-world assumption of a single database, and (3) queries frequently rely on commonsense or external knowledge. Consequently, satisfying realistic data needs require integrating heterogeneous sources, modalities, and contextual data. In this paper, we present Blue's Data Intelligence Layer (DIL) designed to support multi-source, multi-modal, and data-centric applications. Blue is a compound AI system that orchestrates agents and data for enterprise settings. DIL serves as the data intelligence layer for agentic data processing, to bridge the semantic gap between user intent and available information by unifying structured enterprise data, world knowledge accessible through LLMs, and personal context obtained through interaction. At the core of DIL is a data registry that stores metadata for diverse data sources and modalities to enable both native and natural language queries. DIL treats LLMs, the Web, and the User as source 'databases', each with their own query interface, elevating them to first-class data sources. DIL relies on data planners to transform user queries into executable query plans. These plans are declarative abstractions that unify relational operators with other operators spanning multiple modalities. DIL planners support decomposition of complex requests into subqueries, retrieval from diverse sources, and finally reasoning and integration to produce final results. We demonstrate DIL through two interactive scenarios in which user queries dynamically trigger multi-source retrieval, cross-modal reasoning, and result synthesis, illustrating how compound AI systems can move beyond single database NL2SQL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。