通过元学习与自适应更新,提升轨迹预测在分布漂移下的泛化能力。
MetaDAT: Generalizable Trajectory Prediction via Meta Pre-training and Data-Adaptive Test-Time Updating
- 用元学习优化模型,实现测试时快速适应新数据。
- 在nuScenes、Lyft、Waymo上超越现有方法,误差更低。
- 自适应调整学习率和更新频率,适合实际高帧率场景。
现有轨迹预测方法在测试时遭遇分布偏移时性能显著下降。尽管已有测试时训练技术用于适应,但当前方法依赖固定预训练模型,缺乏在线学习灵活性,且更新规则固定,无法适配测试数据特征。为此,我们提出一种元学习框架,在预训练阶段对模拟的测试时适应任务进行双层优化,直接优化预测器以实现快速准确的在线适应。测试时,引入数据自适应模型更新机制,根据在线部分导数和困难样本选择,动态调整预设的学习率与更新频率,使学习率更贴合测试数据,并聚焦于信息量大的困难样本以提高效率。在nuScenes、Lyft、Waymo等跨数据集分布偏移场景下进行实验,结果表明本方法在适应精度上优于当前最优测试时训练方法。此外,在次优学习率和高帧率需求下仍表现优异,展现出强鲁棒性与实用性。
原文摘要 · Abstract (English)
Existing trajectory prediction methods exhibit significant performance degradation under distribution shifts during test time. Although test-time training techniques have been explored to enable adaptation, current approaches rely on an offline pre-trained predictor that lacks online learning flexibility. Moreover, they depend on fixed online model updating rules that do not accommodate the specific characteristics of test data. To address these limitations, we first propose a meta-learning framework to directly optimize the predictor for fast and accurate online adaptation, which performs bi-level optimization on the performance of simulated test-time adaptation tasks during pre-training. Furthermore, at test time, we introduce a data-adaptive model updating mechanism that dynamically adjusts the predefined learning rates and updating frequencies based on online partial derivatives and hard sample selection. This mechanism enables the online learning rate to suit the test data, and focuses on informative hard samples to enhance efficiency. Experiments are conducted on various challenging cross-dataset distribution shift scenarios, including nuScenes, Lyft, and Waymo. Results demonstrate that our method achieves superior adaptation accuracy, surpassing state-of-the-art test-time training methods for trajectory prediction. Additionally, our method excels under suboptimal learning rates and high FPS demands, showcasing its robustness and practicality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。