arXiv:2509.17462cs.CV2025-09ICCV

MAESTRO通过特征增强与抑制,解决多任务3D感知中的干扰问题。

MAESTRO: Task-Relevant Optimization via Adaptive Feature Enhancement and Suppression for Multi-task 3D Perception

论文配图:MAESTRO: Task-Relevant Optimization via Adaptive Feature Enhancement and Suppression for Multi-task 3D Perception
图 1 · 摘自论文原文
  • 按类别分组生成前景/背景原型,指导任务特异性特征提取。
  • 在nuScenes和Occ3D上三项任务均超越现有方法,性能更优。
  • 适合需要高效融合多个3D感知任务的自动驾驶系统研究者。

多任务学习旨在基于共享数据表示同时完成多个任务,虽提升学习效率,但不同目标优化可能引发任务冲突,导致性能下降。为此,我们提出MAESTRO,一个结构化框架,用于生成任务特定特征并缓解多任务3D感知中的特征干扰,涵盖3D目标检测、鸟瞰图(BEV)地图分割和3D占据预测。MAESTRO包含三个组件:类别原型生成器(CPG)、任务特异性特征生成器(TSFG)和场景原型聚合器(SPA)。CPG将类别分为前景与背景组,生成组级原型;前景原型分配给3D目标检测任务,背景原型分配给地图分割任务,两者均用于3D占据预测任务。TSFG利用这些原型组保留任务相关特征并抑制无关特征,从而提升各任务表现。SPA通过融合3D目标检测头与地图分割头的信息,增强分配给3D占据预测任务的原型组。在nuScenes和Occ3D基准上的大量实验表明,MAESTRO在3D目标检测、BEV地图分割和3D占据预测任务中均持续优于现有方法。

原文摘要 · Abstract (English)

The goal of multi-task learning is to learn to conduct multiple tasks simultaneously based on a shared data representation. While this approach can improve learning efficiency, it may also cause performance degradation due to task conflicts that arise when optimizing the model for different objectives. To address this challenge, we introduce MAESTRO, a structured framework designed to generate task-specific features and mitigate feature interference in multi-task 3D perception, including 3D object detection, bird's-eye view (BEV) map segmentation, and 3D occupancy prediction. MAESTRO comprises three components: the Class-wise Prototype Generator (CPG), the Task-Specific Feature Generator (TSFG), and the Scene Prototype Aggregator (SPA). CPG groups class categories into foreground and background groups and generates group-wise prototypes. The foreground and background prototypes are assigned to the 3D object detection task and the map segmentation task, respectively, while both are assigned to the 3D occupancy prediction task. TSFG leverages these prototype groups to retain task-relevant features while suppressing irrelevant features, thereby enhancing the performance for each task. SPA enhances the prototype groups assigned for 3D occupancy prediction by utilizing the information produced by the 3D object detection head and the map segmentation head. Extensive experiments on the nuScenes and Occ3D benchmarks demonstrate that MAESTRO consistently outperforms existing methods across 3D object detection, BEV map segmentation, and 3D occupancy prediction tasks.

3D感知多任务学习自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。