arXiv:2509.10147cs.AI2025-09被引 19

AI代理自组织经济需主动设计,避免失控风险。

Virtual Agent Economies

  • 构建沙盒经济框架,分析代理经济的起源与隔离程度。
  • 代理经济将高度开放,可能引发系统性风险与不平等加剧。
  • 建议通过拍卖机制和使命经济实现可控协调,适合政策与技术设计者。

自主人工智能代理的快速普及正催生一种新型经济体系,代理在人类直接监管之外以空前规模和速度进行交易与协作。我们提出“沙盒经济”框架,从两个关键维度刻画该新兴系统:其起源(自发生成或有意设计)以及与现有人类经济的分离程度(可渗透或不可渗透)。当前趋势指向一个庞大且高度可渗透的自发性AI代理经济,既带来前所未有的协同机遇,也伴随系统性经济风险和不平等加剧的挑战。本文探讨若干可实现安全可控的设计选择,包括公平资源分配与偏好协调的拍卖机制、围绕集体目标的AI“使命经济”设计,以及确保信任、安全与问责的社会技术基础设施。我们主张积极设计可调控的代理市场,以确保这一技术变革最终服务于人类长期共同繁荣。

原文摘要 · Abstract (English)

The rapid adoption of autonomous AI agents is giving rise to a new economic layer where agents transact and coordinate at scales and speeds beyond direct human oversight. We propose the "sandbox economy" as a framework for analyzing this emergent system, characterizing it along two key dimensions: its origins (emergent vs. intentional) and its degree of separateness from the established human economy (permeable vs. impermeable). Our current trajectory points toward a spontaneous emergence of a vast and highly permeable AI agent economy, presenting us with opportunities for an unprecedented degree of coordination as well as significant challenges, including systemic economic risk and exacerbated inequality. Here we discuss a number of possible design choices that may lead to safely steerable AI agent markets. In particular, we consider auction mechanisms for fair resource allocation and preference resolution, the design of AI "mission economies" to coordinate around achieving collective goals, and socio-technical infrastructure needed to ensure trust, safety, and accountability. By doing this, we argue for the proactive design of steerable agent markets to ensure the coming technological shift aligns with humanity's long-term collective flourishing.

AI经济代理系统治理设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。