arXiv:2605.26155cs.ROcs.AI2026-05中稿 · CVPR

自适应引导能提升自动驾驶在观测不全时的表现,但需谨慎设计调度策略。

When Does Adaptive Guidance Help? Belief-Aware Privileged Distillation for Autonomous Driving Under Partial Observability

论文配图:When Does Adaptive Guidance Help? Belief-Aware Privileged Distillation for Autonomous Driving Under Partial Observability
图 1 · 摘自论文原文
  • 用集成预测分歧动态调节知识蒸馏强度,实现不确定性感知的引导机制。
  • 严重遮挡下自适应系数快速降至最小值,导致性能下降;线性衰减策略表现最优。
  • 建议优先考虑调度策略而非复杂自适应机制,集成目标设计至关重要。

Guided Soft Actor-Critic (GSAC) 将全状态教师模型的知识蒸馏到部分观测学生模型中用于自动驾驶,但使用固定蒸馏系数 lambda,未考虑代理的不确定性。本文提出 Belief-Aware GSAC (BA-GSAC),通过集成分歧调节 lambda,以此作为系统性实证研究的测试平台:自适应引导何时真正有效?在 Highway-Env 上评估五种策略(固定 lambda=0.01/0.1、自适应、线性衰减、原始 SAC),覆盖三种部分可观测马尔可夫决策过程(POMDP)难度。初步单种子实验显示,在轻度与中度部分可观测性下有收益;但在严重遮挡(3个种子验证)下,自适应系数约在3,000步内坍缩至 lambda_min。我们归因于‘可观测性盲区’现象:集成模型仅基于可见信息预测,即使在重度遮挡下也保持低分歧,无法识别缺失信息。我们诊断根本原因并提出架构修复方案(使用教师特权访问训练集成模型进行全状态预测),虽未在此验证,但表明预热阶段已带来可观稳定(方差降低至13.3%,相比常数 lambda=0.01 的29.8%)。事实上,简单的确定性线性衰减调度在所有指标上取得最佳严重 POMDP 性能(均值116.5,方差8.9%),说明稳定性收益主要来自调度策略而非集成机制本身。这些发现为设计不确定性感知的师生框架提供了实用指导,并强调了集成预测目标的关键作用。

原文摘要 · Abstract (English)

Guided Soft Actor-Critic (GSAC) distills knowledge from a privileged full-state teacher to a partial-observation student for autonomous driving, but uses a fixed distillation coefficient lambda regardless of the agent's uncertainty. We present Belief-Aware GSAC (BA-GSAC), which modulates lambda via ensemble disagreement, and use it as a testbed for a systematic empirical study asking: when does adaptive guidance actually help? Evaluating five strategies (fixed lambda in {0.01, 0.1}, adaptive, linear decay, and vanilla SAC) across three POMDP difficulty levels on Highway-Env, we find that preliminary single-seed runs suggest benefits under mild and moderate partial observability, but under severe occlusion (evaluated with 3 seeds for all methods) the adaptive coefficient collapses to lambda_min within about 3K steps. We trace this to an observability blindness phenomenon: because the ensemble predicts partial observations, it achieves low disagreement even under heavy occlusion, modeling what is visible but unable to detect what is missing. We diagnose the root cause and propose an architectural fix (training the ensemble on full-state predictions using the guiding actor's privileged access); while not validated here, we show that even with current limitations, the warmup phase provides measurable stabilization (CV=13.3% vs. 29.8% for constant lambda=0.01). In fact, a simple deterministic linear decay schedule achieves the best severe-POMDP performance across all metrics (mean 116.5, CV=8.9%), suggesting that the scheduling effect, not the ensemble, drives the stability benefit. These findings provide practical guidance for designing uncertainty-aware teacher-student frameworks and highlight ensemble prediction targets as an important design choice.

自动驾驶知识蒸馏不确定性建模强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。