用强化学习与零知识审计实现跨市场交易的安全合规执行
Safe and Compliant Cross-Market Trade Execution via Constrained RL and Zero-Knowledge Audits
- 将交易建模为带硬约束的马尔可夫决策过程,结合策略优化与实时动作保护
- 在多种压力场景下均无违规,实施缺口和波动率显著降低,95%置信水平显著优于基线
- 适合金融量化、监管科技及对可验证AI有需求的机构部署
我们提出一种跨市场算法交易系统,平衡执行质量与严格合规。系统包含高层规划器、强化学习执行代理和独立合规代理。将交易执行建模为带硬约束的马尔可夫决策过程,约束包括参与度上限、价格区间和自交易规避。执行代理采用近端策略优化训练,运行时通过动作防护层将不安全动作投影至可行集。为支持审计而不暴露私有信号,引入零知识合规审计层,生成所有操作满足约束的密码学证明。在基于ABIDES的多交易所仿真环境中评估,对比标准基线(如TWAP、VWAP)。学习策略在多种压力场景(高延迟、部分成交、合规模块开关、约束限值变化)下均未出现违规,实现缺口和方差显著降低。使用配对t检验在95%置信水平报告效果,并通过CVaR分析尾部风险。研究位于最优执行、安全强化学习、监管科技与可验证AI交界处,讨论伦理考量、局限性(如建模假设与计算开销)及实际部署路径。
原文摘要 · Abstract (English)
We present a cross-market algorithmic trading system that balances execution quality with rigorous compliance enforcement. The architecture comprises a high-level planner, a reinforcement learning execution agent, and an independent compliance agent. We formulate trade execution as a constrained Markov decision process with hard constraints on participation limits, price bands, and self-trading avoidance. The execution agent is trained with proximal policy optimization, while a runtime action-shield projects any unsafe action into a feasible set. To support auditability without exposing proprietary signals, we add a zero-knowledge compliance audit layer that produces cryptographic proofs that all actions satisfied the constraints. We evaluate in a multi-venue, ABIDES-based simulator and compare against standard baselines (e.g., TWAP, VWAP). The learned policy reduces implementation shortfall and variance while exhibiting no observed constraint violations across stress scenarios including elevated latency, partial fills, compliance module toggling, and varying constraint limits. We report effects at the 95% confidence level using paired t-tests and examine tail risk via CVaR. We situate the work at the intersection of optimal execution, safe reinforcement learning, regulatory technology, and verifiable AI, and discuss ethical considerations, limitations (e.g., modeling assumptions and computational overhead), and paths to real-world deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。