用可逆网络统一不同任务的特征分布,解决标注不全时的知识迁移难题。
NexusFlow: Unifying Disparate Tasks under Partial Supervision via Invertible Flow Networks
- 通过可逆耦合层对齐多任务特征分布,构建共享表征空间。
- 在nuScenes上优于现有方法,实现自动驾驶中稠密与稀疏任务的联合优化。
- 适用于结构差异大的任务,适合多任务学习中数据标注不完整场景。
部分监督多任务学习(PS-MTL)旨在当标注不完整时跨任务利用知识。现有方法主要聚焦于同质、稠密预测任务,忽视了更现实的结构异构任务挑战。为此,我们提出NexusFlow——一种轻量、即插即用的框架,适用于两类场景。NexusFlow引入一组带有可逆耦合层的代理网络,对齐各任务的潜在特征分布,构建统一表征以实现有效知识迁移。耦合层为双射映射,在保留信息的同时将特征映射至共享规范空间,避免表征坍缩,并在不降低表达能力的前提下实现结构差异任务间的对齐。我们在核心挑战——领域分割的自动驾驶任务上进行评估,其中地图重建为稠密任务,多目标跟踪为稀疏任务,且在不同地理区域有监督。NexusFlow在nuScenes上达到新最优性能,超越强基线。为验证通用性,我们进一步在NYUv2上测试,采用三个同质稠密预测任务(语义分割、深度估计、表面法向)作为典型N-task PS-MTL场景。NexusFlow在所有任务上均取得一致提升,证实其广泛适用性。
原文摘要 · Abstract (English)
Partially Supervised Multi-Task Learning (PS-MTL) aims to leverage knowledge across tasks when annotations are incomplete. Existing approaches, however, have largely focused on the simpler setting of homogeneous, dense prediction tasks, leaving the more realistic challenge of learning from structurally diverse tasks unexplored. To this end, we introduce NexusFlow, a novel, lightweight, and plug-and-play framework effective in both settings. NexusFlow introduces a set of surrogate networks with invertible coupling layers to align the latent feature distributions of tasks, creating a unified representation that enables effective knowledge transfer. The coupling layers are bijective, preserving information while mapping features into a shared canonical space. This invertibility avoids representational collapse and enables alignment across structurally different tasks without reducing expressive capacity. We first evaluate NexusFlow on the core challenge of domain-partitioned autonomous driving, where dense map reconstruction and sparse multi-object tracking are supervised in different geographic regions, creating both structural disparity and a strong domain gap. NexusFlow sets a new state-of-the-art result on nuScenes, outperforming strong partially supervised baselines. To demonstrate generality, we further test NexusFlow on NYUv2 using three homogeneous dense prediction tasks, segmentation, depth, and surface normals, as a representative N-task PS-MTL scenario. NexusFlow yields consistent gains across all tasks, confirming its broad applicability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。