arXiv:2505.18397cs.MAcs.AI2025-05被引 16

多智能体系统如何更高效安全?这篇论文给出分析框架。

An Outlook on the Opportunities and Challenges of Multi-Agent AI Systems

  • 构建形式化框架,从效能与安全双维度分析多智能体系统
  • 实验验证其在数据科学自动化中提升可靠性与适应性
  • 适合关注AI协作、系统安全与可信设计的研究者

多智能体系统(MAS)由多个自主智能体组成,通过交互、信息交换和基于内部生成模型的决策实现协同。近年来,大语言模型与工具使用型智能体的发展使MAS在科学发现和协同自动化等领域日益实用。然而关键问题仍存:多智能体系统何时优于单智能体系统?智能体间交互会带来哪些新型安全风险?如何评估其可靠性与结构?本文提出一个形式化分析框架,聚焦效能与安全两大核心维度。研究探讨了多智能体系统是否真正提升了鲁棒性、适应性和性能,还是仅重新包装了集成学习等已有技术。同时分析了智能体间动态可能放大或抑制系统漏洞。尽管多智能体系统对信号处理领域尚属新兴,但其有望作为强大抽象,将分布式估计与传感器融合等经典工具拓展至更高层次、以策略驱动的推理场景。通过在数据科学自动化任务上的实验,凸显了多智能体系统重塑信号处理系统设计与信任机制的潜力。

原文摘要 · Abstract (English)

A multi-agent AI system (MAS) is composed of multiple autonomous agents that interact, exchange information, and make decisions based on internal generative models. Recent advances in large language models and tool-using agents have made MAS increasingly practical in areas like scientific discovery and collaborative automation. However, key questions remain: When are MAS more effective than single-agent systems? What new safety risks arise from agent interactions? And how should we evaluate their reliability and structure? This paper outlines a formal framework for analyzing MAS, focusing on two core aspects: effectiveness and safety. We explore whether MAS truly improve robustness, adaptability, and performance, or merely repackage known techniques like ensemble learning. We also study how inter-agent dynamics may amplify or suppress system vulnerabilities. While MAS are relatively new to the signal processing community, we envision them as a powerful abstraction that extends classical tools like distributed estimation and sensor fusion to higher-level, policy-driven inference. Through experiments on data science automation, we highlight the potential of MAS to reshape how signal processing systems are designed and trusted.

多智能体系统安全可信AI信号处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。