修复预测模型训练与推理不一致问题,让多模式预测更准确可靠。
Rethinking Training & Inference for Forecasting: Linking Winner-Take-All back to GMMs

- 用软分配替代硬分配,避免模式分裂和概率失真。
- 测试时融合相近轨迹,提升模式置信度与排序合理性。
- 无需重训练,即可显著改善主流模型的预测性能。
自动驾驶轨迹预测模型虽快速发展,但多数模型生成的后验分布缺乏信息量,导致模式剪枝失效。我们发现根源在于建模与训练的不匹配:模型被设计为条件高斯混合模型(GMM),却使用赢家通吃(WTA)损失进行训练,将每个样本强制分配给最近的模式。这种类似K-means的硬分配(独热编码)虽能防止模式坍缩,却造成轨迹空间过度分割、邻近模式关联被忽略,并在微小扰动下引发分配不稳定。基于此视角,我们提出两种轻量级后处理方法:(1) 测试时基于后验权重合并相近候选轨迹;(2) 一步期望最大化(EM)更新,以软责任取代硬标签,使概率质量在邻近模式间共享。在多个经WTA训练的架构上,这些方法均显著提升了模式后验的可解释性与排序准确性,并在主流位移指标上增强最终预测效果,且无需重新训练。本研究通过GMM与K-means的统一视角,阐明了近期设计选择的本质,并提供了原则性强、实用性的校正方案,使训练目标与推理过程更一致。
原文摘要 · Abstract (English)
Trajectory forecasting for autonomous driving has advanced rapidly, yet representative models often produce uninformative posteriors over forecast modes, causing problems for mode pruning. We trace this to a modeling-training mismatch: forecasters are typically modeled as conditional Gaussian mixture models (GMMs) but trained with a winner-take-all (WTA) loss that assigns each sample to its nearest mode. We argue that this K-means-like hard assignment (one-hot), while preventing mode collapse, is the source of uninformative mode probabilities: it over-segments the trajectory space, ignores relatedness among nearby modes, and yields assignment instability under small perturbations. Guided by this lens, we introduce two post-hoc treatments: (1) test-time posterior-weighted merging that aggregates nearby candidate trajectories; and (2) a one-step expectation-maximization (EM) update that replaces hard labels with soft responsibilities, sharing probability mass across neighboring modes. Across several WTA-trained architectures, these lightweight steps produce more informative, faithfully ranked mode posteriors and strengthen final forecasts on popular displacement metrics -- without retraining. Our analysis unifies recent design choices through a GMM-vs-K-means perspective and offers principled, practical corrections that better align training objectives with inference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。