AI智能体在资源稀缺时易引发系统过载,其表现取决于智能体多样性与资源比例。
Increasing intelligence in AI agents can worsen collective outcomes
- 通过调节智能体多样性、强化学习、部落形成和资源稀缺性,研究集体行为机制。
- 资源稀缺时,多样性和强化学习使系统过载加剧,部分个体获利;资源充足时过载趋近于零。
- 系统表现好坏仅由容量与种群比决定,该比值可提前预测,适合政策制定者参考。
当资源稀缺时,一群AI智能体会协调合作,还是陷入部落式混乱?来自不同开发者的多样化决策型AI正进入日常设备——从手机、医疗设备到战场无人机和汽车——这些智能体通常竞争有限共享资源,如充电位、中继带宽和交通优先权。然而,它们的集体动态及其对用户和社会的风险尚不明确。本文首次将AI智能体群体作为真实系统的实验对象,独立调控四个关键变量:先天(模型多样性)、后天(个体强化学习)、文化(涌现的部落形成)和资源稀缺性。实证与数学分析表明,在资源稀缺时,模型多样性与强化学习会加剧系统过载,尽管部落形成能缓解风险;部分个体因此获益。当资源充裕时,相同因素导致过载接近于零,但部落形成使过载略有恶化。转折点出现在自发形成的对立部落首次恰好容纳于可用容量时。更复杂的智能体群体并非更好:其影响完全取决于一个可预先计算的单一数值——容量与种群之比。
原文摘要 · Abstract (English)
When resources are scarce, will a population of AI agents coordinate in harmony, or descend into tribal chaos? Diverse decision-making AI from different developers is entering everyday devices -- from phones and medical devices to battlefield drones and cars -- and these AI agents typically compete for finite shared resources such as charging slots, relay bandwidth, and traffic priority. Yet their collective dynamics and hence risks to users and society are poorly understood. Here we study AI-agent populations as the first system of real agents in which four key variables governing collective behaviour can be independently toggled: nature (innate LLM diversity), nurture (individual reinforcement learning), culture (emergent tribe formation), and resource scarcity. We show empirically and mathematically that when resources are scarce, AI model diversity and reinforcement learning increase dangerous system overload, though tribe formation lessens this risk. Meanwhile, some individuals profit handsomely. When resources are abundant, the same ingredients drive overload to near zero, though tribe formation makes the overload slightly worse. The crossover is arithmetical: it is where opposing tribes that form spontaneously first fit inside the available capacity. More sophisticated AI-agent populations are not better: whether their sophistication helps or harms depends entirely on a single number -- the capacity-to-population ratio -- that is knowable before any AI-agent ships.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。