构建电商风控场景下的多步交互式GUI代理框架,解决传统爬虫无法处理复杂网页操作的问题。
RISK: A Framework for GUI Agents in E-commerce Risk Management
- 设计RISK框架,整合数据集、评测基准与强化学习微调方法,支持多步状态化交互
- 在离线测试中多步任务准确率提升8.8%,仅用7.2%参数量即达顶尖基线性能
- 适合需要自动化复杂电商网页操作的风控系统开发者和研究者使用
电商风险管控需通过多步、有状态的交互聚合多样化嵌入式网页数据,传统爬虫与多数图形界面(GUI)代理难以应对。这些代理通常局限于单步任务,缺乏对动态交互内容的有效管理能力。为此,我们提出RISK框架,用于构建和部署该领域的GUI代理。RISK包含三个部分:(1) RISK-Data,一个由8,492条单步和2,386条多步交互轨迹组成的高保真浏览器采集数据集;(2) RISK-Bench,涵盖802条单步与320条多步轨迹的评测基准,覆盖三个难度等级;(3) RISK-R1,一种受R1启发的强化微调框架,考虑输出格式约束、单步/多步奖励及任务级重加权。实验表明,RISK-R1在离线单步任务上提升6.8%,多步任务提升8.8%,仅使用当前最优基线7.2%的参数量,线上评估任务成功率最高达70.5%。RISK为电商风控中的复杂网页自动化提供了可扩展的专用解决方案。代码已开源于https://github.com/RenqiChen/RISK-GUI。
原文摘要 · Abstract (English)
E-commerce risk management requires aggregating diverse, deeply embedded web data through multi-step, stateful interactions, which traditional scraping methods and most existing Graphical User Interface (GUI) agents cannot handle. These agents are typically limited to single-step tasks and lack the ability to manage dynamic, interactive content critical for effective risk assessment. To address this challenge, we introduce RISK, a novel framework designed to build and deploy GUI agents for this domain. RISK integrates three components: (1) RISK-Data, a dataset of 8,492 single-step and 2,386 multi-step interaction trajectories, collected through a high-fidelity browser framework and a meticulous data curation process; (2) RISK-Bench, a benchmark with 802 single-step and 320 multi-step trajectories across three difficulty levels for standardized evaluation; and (3) RISK-R1, a R1-style reinforcement fine-tuning framework considering four aspects: (i) Output Format Constraint, (ii) Single-step and (iii) Multi-step Level Reward, and (iv) Task Level Reweight. Experiments show that RISK-R1 achieves a 6.8% improvement in offline single-step and an 8.8% improvement in offline multi-step, using only 7.2% of the parameters of the SOTA baseline. Moreover, it attains a top task success rate of 70.5% in online evaluation. RISK provides a scalable, domain-specific solution for automating complex web interactions in e-commerce risk management. The code is available at https://github.com/RenqiChen/RISK-GUI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。