用黑板架构让多个AI agent自主协作找数据,效率更高更灵活。
LLM-Based Multi-Agent Blackboard System for Information Discovery in Data Science
- 采用黑板机制,各AI代理根据能力自愿响应任务,无需中央控制者掌握所有知识。
- 在3个数据发现基准上,端到端成功率提升13%-57%,数据发现F1最高增9%。
- 适合大规模异构数据场景,尤其适用于主控方无法完全观测子代理能力的环境。
大语言模型(LLMs)为数据科学带来了新机遇,但其应用常受限于从海量数据湖中发现相关数据的难题。现有方法存在局限:单代理与多代理系统易被大规模、异构文件压垮;主从式多代理系统依赖中央控制器精确掌握每个子代理的能力,这在大规模场景中难以实现,因主代理无法全面观测子代理的知识与技能。本文提出一种受传统人工智能黑板架构启发的新型多代理范式。在该框架中,中央代理将请求发布至共享黑板,自主的下属代理——无论是负责数据湖分区还是网络检索——可根据自身能力自愿响应。此设计通过消除中央协调者对各代理专长的预先认知需求,显著提升系统的可扩展性与灵活性。我们在三个需数据发现的任务基准上评估该方法:KramaBench及改进版DSBench和DA-Code。结果表明,黑板架构显著优于强基线,端到端成功率提升13%-57%,数据发现F1最高相对提升9%。
原文摘要 · Abstract (English)
Advances in large language models (LLMs) have created new opportunities in data science, but their deployment is often limited by the challenge of finding relevant data in large data lakes. Existing methods struggle with this: both single- and multi-agent systems are quickly overwhelmed by large, heterogeneous files, and master-slave multi-agent systems rely on a rigid central controller that requires precise knowledge of each sub-agent's capabilities, which is not possible in large-scale settings where the main agent lacks full observability over sub-agents' knowledge and competencies. We propose a novel multi-agent paradigm inspired by the blackboard architecture for traditional AI models. In our framework, a central agent posts requests to a shared blackboard, and autonomous subordinate agents - either responsible for a partition of the data lake or retrieval from the web - volunteer to respond based on their capabilities. This design improves scalability and flexibility by removing the need for a central coordinator to know each agent's expertise or internal knowledge. We evaluate the approach on three benchmarks that require data discovery: KramaBench and modified versions of DSBench and DA-Code. Results show that the blackboard architecture substantially outperforms strong baselines, achieving 13%-57% relative improvements in end-to-end success and up to a 9% relative gain in data discovery F1 over the best baseline.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。