构建民航多模态大模型,整合语音、雷达等数据实现智能分析
AviationLMM: A Large Multimodal Foundation Model for Civil Aviation
- 统一接收语音、雷达、传感器等多源数据,跨模态融合理解
- 支持风险预警、事故还原等多任务输出,提升实时决策能力
- 适合航空安全研究与AI系统开发者参考
民用航空是全球交通与贸易的基石,保障其安全、高效与客户满意度至关重要。然而现有AI解决方案仍局限于单一任务或模态,难以融合语音通信、雷达轨迹、传感器流和文本报告等异构数据,制约了态势感知、适应性与实时决策支持。本文提出航空多模态大模型 AviationLMM 的愿景,旨在统一民航异构数据流,实现理解、推理、生成与代理应用。模型可处理空地语音、监视数据、机载遥测、视频及结构化文本,进行跨模态对齐与融合,输出包括情况摘要、风险警报、预测诊断与多模态事件重构等多种结果。为实现该愿景,我们识别了关键研究方向:数据获取、对齐融合、预训练、推理、可信度、隐私保护、对缺失模态的鲁棒性以及合成场景生成。通过阐述 AviationLMM 的设计与挑战,旨在推动民航基础模型发展,促进协同研究,构建集成、可信、隐私保护的航空AI生态系统。
原文摘要 · Abstract (English)
Civil aviation is a cornerstone of global transportation and commerce, and ensuring its safety, efficiency and customer satisfaction is paramount. Yet conventional Artificial Intelligence (AI) solutions in aviation remain siloed and narrow, focusing on isolated tasks or single modalities. They struggle to integrate heterogeneous data such as voice communications, radar tracks, sensor streams and textual reports, which limits situational awareness, adaptability, and real-time decision support. This paper introduces the vision of AviationLMM, a Large Multimodal foundation Model for civil aviation, designed to unify the heterogeneous data streams of civil aviation and enable understanding, reasoning, generation and agentic applications. We firstly identify the gaps between existing AI solutions and requirements. Secondly, we describe the model architecture that ingests multimodal inputs such as air-ground voice, surveillance, on-board telemetry, video and structured texts, and performs cross-modal alignment and fusion, and produces flexible outputs ranging from situation summaries and risk alerts to predictive diagnostics and multimodal incident reconstructions. In order to fully realize this vision, we identify key research opportunities to address, including data acquisition, alignment and fusion, pretraining, reasoning, trustworthiness, privacy, robustness to missing modalities, and synthetic scenario generation. By articulating the design and challenges of AviationLMM, we aim to boost the civil aviation foundation model progress and catalyze coordinated research efforts toward an integrated, trustworthy and privacy-preserving aviation AI ecosystem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。