提出FSCA-Net,分离共性与特有特征,提升跨数据集人群计数鲁棒性。
FSCA-Net: Feature-Separated Cross-Attention Network for Robust Multi-Dataset Training
- 将特征显式拆分为通用与特定两类,避免信息纠缠
- 跨注意力模块自适应融合两类特征,提升迁移效果
- 适合需要跨场景部署的智能监控系统
人群计数在公共安全、交通管理与智慧城市建设中至关重要。尽管基于CNN和Transformer的模型取得显著进展,但在不同环境间应用时,因领域差异大而性能下降。直接联合训练多数据集虽看似能增强泛化,却导致负迁移,因共享与特定特征相互缠绕。为此,本文提出特征分离与交叉注意力网络FSCA-Net,统一框架显式将特征表示分解为域不变与域特定成分。新颖的跨注意力融合模块自适应建模两类成分间的交互,实现有效知识迁移的同时保留数据集特异性。此外,引入互信息优化目标,最大化域不变特征一致性,最小化域特定特征冗余,促进互补的共享-私有表征。在多个人群计数基准上的大量实验表明,FSCA-Net有效缓解负迁移,实现最优跨数据集泛化,为真实世界人群分析提供鲁棒且可扩展的解决方案。
原文摘要 · Abstract (English)
Crowd counting plays a vital role in public safety, traffic regulation, and smart city management. However, despite the impressive progress achieved by CNN- and Transformer-based models, their performance often deteriorates when applied across diverse environments due to severe domain discrepancies. Direct joint training on multiple datasets, which intuitively should enhance generalization, instead results in negative transfer, as shared and domain-specific representations become entangled. To address this challenge, we propose the Feature Separation and Cross-Attention Network FSCA-Net, a unified framework that explicitly disentangles feature representations into domain-invariant and domain-specific components. A novel cross-attention fusion module adaptively models interactions between these components, ensuring effective knowledge transfer while preserving dataset-specific discriminability. Furthermore, a mutual information optimization objective is introduced to maximize consistency among domain-invariant features and minimize redundancy among domain-specific ones, promoting complementary shared-private representations. Extensive experiments on multiple crowd counting benchmarks demonstrate that FSCA-Net effectively mitigates negative transfer and achieves state-of-the-art cross-dataset generalization, providing a robust and scalable solution for real-world crowd analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。