arXiv:2608.14332cs.ROcs.LG2026-08

CORAL通过分阶段训练让自动驾驶逐步掌握导航、避障、守规等能力。

CORAL: Curriculum-Optimized Reward Adaptation for LiDAR-Based Goal-Directed Urban Driving

论文配图:CORAL: Curriculum-Optimized Reward Adaptation for LiDAR-Based Goal-Directed Urban Driving
图 1 · 摘自论文原文
  • 设计五阶段渐进式训练流程,逐步增加路线长度与约束难度。
  • 在最长路线和全约束下100%成功,基线仅为5%~10%。
  • 无需点云编码,可零样本迁移到7个新城市,成功率68%-98%。

强化学习在自动驾驶中前景广阔,但长时程目标导航需同时掌握多项竞争行为——抵达远距离目标、沿路线行驶、避障、遵守交通信号等,而固定目标无法明确学习顺序。本文提出CORAL,融合双进度机制:五阶段课程训练逐步延长路径并收紧行为约束;阶段感知奖励动态调整各成分权重,从任务进展转向路线遵循、安全、平滑性与规则合规。策略采用多流演员-评论家网络,基于PPO在CARLA中训练,状态空间为99维紧凑表示,包含极坐标激光雷达直方图、车辆遥测数据、本体帧路线几何与交通规则指标,无需点云编码或鸟瞰图栅格化。在相同评估协议下,相较两个PPO基线,CORAL在最长路径及全部约束条件下20次评估均成功抵达目标,基线仅达5%和10%;因子析因消融实验表明,单独使用任一机制均不如组合效果:移除任一机制均导致成功率与路线完成率下降,两者皆弃则成功率降至55%。模型在一座城市训练后,零样本迁移至七座未见城市,在100-150米长路径上成功率维持68%-98%,平均横向偏差低于0.35米。

原文摘要 · Abstract (English)

Reinforcement learning is promising for autonomous urban driving, but long-horizon goal-directed navigation asks a policy to acquire several competing behaviors at once--reaching a distant goal, tracking a route, avoiding obstacles, obeying signals--and a fixed objective gives no order in which to learn them. This paper presents CORAL, which advances two schedules together: a five-stage curriculum that progressively lengthens routes and tightens behavioral constraints, and a stage-aware reward whose component weights shift emphasis from mission progress toward route following, safety, smoothness, and rule compliance as the task hardens. The policy is a multi-stream actor-critic network trained with Proximal Policy Optimization (PPO) in CARLA on a compact 99-dimensional state pairing a polar LiDAR histogram with vehicle telemetry, ego-frame route geometry, and traffic-rule indicators--no point-cloud encoder, no bird's-eye-view rasterization. Against two PPO baselines under an identical protocol, CORAL reaches the goal in all twenty evaluation episodes on the longest routes under the full set of behavioral constraints, where the baselines reach 5% and 10%; a factorial ablation shows that neither schedule alone matches their combination: removing either lowers both success and route completion, and disabling both drops success to 55%. Trained in one town, the policy transfers zero-shot to seven unseen towns, succeeding in 68-98% of episodes on routes of the same 100-150 m length, with mean lateral deviation below 0.35 m.

自动驾驶强化学习课程学习激光雷达

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。