首个统一安全强化学习训练与审计的框架,保障机器人训练可复现。
parallelcbf: A composable safety-filter and auditability framework for tensor-parallel reinforcement learning

- 将并行无人机环境、安全滤波器、行为克隆管道与审计功能模块化集成
- 39项安全测试1.67秒完成,3万次行为克隆数据可溯源且防篡改
- 适合关注机器人安全与实验可复现性的研究者使用
现有框架缺乏对安全强化学习全流程的支持。ParallelCBF首次整合(一)张量并行无人机环境,(二)硬门限控制屏障函数(CBF)安全滤波器,(三)分片行为克隆到强化学习的流水线,以及(四)原生可组合的操作审计能力——包括事前注册、看门狗注册、故障溯源和数据集审计。我们发布ParallelCBF v0.1.0,采用四层可组合API,提供基于CPU的双屏障CBF(平方/线性预测)参考实现,可在1.67秒内完成39项属性安全不变性测试;并完成31,415个回合的行为克隆采集,其课程配置、每桶产量及数据集SHA-256均可通过框架内置的 exttt{ops}原语审计。在一次端到端流程中,审计层成功阻止了未满足预注册收敛标准的下游训练,防止劣化检查点无声传播。我们认为此机制是可复现机器人实证研究的必要条件而非可选功能。可通过 exttt{pip install parallelcbf}安装,源码与发布物见https://github.com/xiaoyang-123-cell/ParallelCBF。
原文摘要 · Abstract (English)
While Isaac Lab provides massive parallel UAV simulation, OmniSafe and safe-control-gym provide constrained-RL benchmarks, and CBFKit provides control-barrier-function synthesis tooling, no existing framework unifies these capabilities for end-to-end safety-constrained training. ParallelCBF is the first framework to unify (i)~tensor-parallel UAV environments, (ii)~hard-gate CBF safety filters, (iii)~sharded BC-to-RL pipelines, and (iv)~first-class operational auditability -- pre-registration, watchdog registries, failure forensics, and dataset audits as composable APIs rather than user-implemented scripts. We release ParallelCBF v0.1.0 under Apache~2.0 with a four-layer composable API, a CPU PyTorch reference implementation of a dual-barrier (squared / linear-predictive) CBF, property-based safety invariance tests across vectorized batch sizes that complete in 1.67~s for the full 39-test suite, and a 31{,}415-episode behavior-cloning collection campaign whose curriculum mix, per-bucket yields, and dataset SHA-256 are auditable through the framework's own \texttt{ops} primitives. We report a representative end-to-end pipeline execution in which the framework's auditability layer halted a downstream training stage that did not meet pre-registered convergence criteria, preventing silent propagation of a degraded checkpoint -- an architectural property we argue is necessary, not merely useful, for reproducible empirical robotics research. The framework is installable via \texttt{pip install parallelcbf}; source and release artifacts are available at https://github.com/xiaoyang-123-cell/ParallelCBF.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。