用历史互动数据增强教学模型,让驾驶教练更懂学生进步轨迹。
Spatio-Temporal Retrieval-based Priors for Adaptive Computational Teaching in Driving

- 通过最近邻检索+交叉注意力,从过往交互中提取有效教学先验。
- 在小样本下仍显著优于非自适应及多种自适应基线模型。
- 适合研究个性化智能教练、长时序行为学习的学者参考。
基于学习的自动驾驶教练系统在复杂操作任务(如高性能驾驶)中,因仅依赖局部上下文推理,难以适应学生长期学习过程和重复师生交互的累积影响。本文提出一种基于模仿学习的自适应教学模型,配备专用的时间推理模块,在低数据条件下可利用历史交互信息进行推断。为弥补有限的交互训练数据,结合教学过程的重复性,模型采用最近邻检索与交叉注意力先验,仅聚焦语义相似的历史交互片段,并通过编码器-解码器结构实现并行教学。我们在两个数据集上验证:(i) 基于Waymo Open Motion Dataset构建的新型半合成闭环纵向师生交互数据集;(ii) 小规模真实世界自然情境赛车教练数据集。结果表明,引入最近邻检索与交叉注意力先验的自适应模型,在多个指标上持续优于非自适应基线及不同先验/时间融合机制的自适应模型。
原文摘要 · Abstract (English)
Learning-based automated coaching systems for complex motor tasks such as high-performance driving remain limited in the ability to be adaptive by their reliance only on local, context-dependent reasoning, failing to account for the long-term temporal nature of student learning and the cumulative impact of repeated teacher-student interactions. In this paper, we propose an imitation learning based computational model for adaptive teaching with a dedicated temporal reasoning module that can reason over the interaction history under low-data regimes. To compensate for limited amounts of interactive training data, and based on the repetitive nature of the teaching process, the model relies on a nearest neighbor retrieval and cross attention prior, reasoning only on a narrowed-down set of semantically similar past interactions with an encoder-decoder based concurrent teaching model. We validate our approach with (i) a novel semi-synthetic closed-loop longitudinal student-teacher interaction dataset based on Waymo Open Motion Dataset and (ii) a small-scale real-world naturalistic simulator race coaching dataset. Our results reveal the consistent advantage of our adaptive teaching model with the nearest neighbor retrieval and cross-attention prior over a non-adaptive baseline as well as a suite of adaptive models that differ in their choice of priors and temporal fusion mechanisms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。