构建可审计的智能交易环境，让AI代理在真实市场中自主完成买卖任务。
Agentic Commerce World: An Auditable and Verifiable Environment for Vibe Commerce
- 设计双代理互动环境，通过协议验证每步操作确保交易可信。
- 基准测试显示模型在200任务和78.5万商品中的准确率分别达65.9%~85.6%。
- 强调过程证据重要性，完整轨迹能暴露阶段瓶颈，适合评估复杂交易系统。
在‘vibe coding’中，人们用自然语言描述软件需求并委托AI代理实现。类比地，vibe commerce允许用户以自然语言表达买卖目标，并将相应任务交由代理执行。然而，商业活动需要独立控制的买家与商家代理在共享市场中交互，同时保护各自的私有目标和权限。我们提出Agentic Commerce World（ACWorld），一个用于评估此类代理在持续交易中表现的环境。通过Vibe Commerce Protocol（VCP），ACWorld在更新共享交易状态前验证代理行为，并记录交互过程，使代理行为可审计、评估可复现。ACWorld基准包含200个任务的能力覆盖赛道和60个大目录赛道，后者搜索785,022个可交易商品列表。十种模型在两赛道上的平均得分分别为65.9%至85.6%和56.1%至91.4%。分析表明，过程级证据至关重要：仅依赖最终状态可能遗漏错误，不完整轨迹仍保留有用信号，而大目录任务能暴露各阶段瓶颈。
原文摘要 · Abstract (English)
In vibe coding, people describe software in natural language and delegate implementation to AI agents. By analogy, vibe commerce allows people to express buying or selling goals in natural language and delegate the corresponding tasks to agents. Commerce, however, requires independently controlled Buyer and Merchant agents to interact in a shared market while preserving their private objectives and distinct authority. We introduce Agentic Commerce World (ACWorld), an environment for evaluating such agents across ongoing transactions. Through its Vibe Commerce Protocol (VCP), ACWorld validates agent actions before updating shared transaction state and records the resulting interactions, making agent behavior auditable and evaluation reproducible. The ACWorld Benchmark contains a 200-task capability-coverage track and a 60-task large-catalog track that searches 785,022 transactable listings. Across ten models, mean scores range from 65.9% to 85.6% and from 56.1% to 91.4%, respectively. Our analysis shows that process-level evidence is necessary: final state alone can miss evaluated errors, incomplete trajectories still retain useful process signals, and large-catalog tasks expose bottlenecks across stages.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。